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CHAPTER  I 


INTRODUCTION 

"The  mission  cf  the  Air  Force  is  to  Fly  and  Fight, 
and  don't  you  forget  it!"  This  slogan  embodies  the  spirit 
drive  and  sense  of  urgency  felt  by  the  professional  DCD 
personnel  assigned  to  the  United  Staxes  Air  Force.  How¬ 
ever,  to  hundreds  of  military  and  civilian  Air  Force  em¬ 
ployees,  the  daily  task  is  not  to  fly  or  fight,  but  rather 
to  educate  men  and  women  in  areas  as  diverse  as  program¬ 
ming  computers  to  maintaining  aircraft  to  acquiring  a 
graduate  degree  in  electrical  engineering.  Each  year  the 
Mr  Force  expends  millions  of  dollars  to  further  the  educa 
tion  of  its  personnel.  The  Air  Force  Institute  of  Tech¬ 
nology  (AFIT)  receives  much  of  this  money  every  year  to 
develop  and  conduct  programs  both  in  Professional  Continu¬ 
ing  Education  and  in  undergraduate,  graduate,  and  posx- 
graduate  disciplines. 

This  is  an  era  of  exponential  growth  in  technology 
and  management  requirements.  It  is  also  a  time  of  tighter 
money  and  reduced  manpower--a  time  when  the  majority  of 
agencies  must  maintain  and  expand  their  knowledge  and 
capabilities  while  using  fewer  total  resources.  In  this 
environment,  AFIT  is  required  to  provide  increasingly 


diverse  cvrri 


.cula  to  a  wider  range  of  BCD  ar.d  allied 
scr.nel  0.3 ins:  the  most  economical  methods  tcssible. 


Background 

The  Air  Force  Institute  of  Technology  is  located 
at  >/r  i  ght  -F  at  tens  on  Air  Force  Base,  Chio.  Organizationally, 
it  is  a  part  of  Air  University,  which  in  turn  is  par'  of 
the  Air  Training  Command.  AFIT  consists  of  a  headquarters 
unit,  the  Civilian  Institutions  Program.,  and  three  major 
schools:  The  School  of  Engineering  (El!)  ,  the  School  of 
Civil  Engineering  (DE)  ,  and  the  School  of  Systems  ar.d 
Logistics  (LS).  Activities  at  this  last  school  are  fur* her 
divided  between  the  Professional  Continuing  Education  (ICE' 
mission  and  the  Graduate  Education  mission.  Professional 
Continuing  Education  offers  a  total  of  bl  different  courses 
per  year  and  has,  since  its  inception  in  1357,  produced 
over  70,CC0  graduates.  Current  annual  resident  student 
throughput  amounts  to  over  7000  professionals  (2:1).  The 
purpose  of  the  PCE  program  is  succinctly  stated  in  the 
AFIT  Catalogue: 

The  [PCE]  program  is  designed  to  provide  the 
highest  quality  of  educational  opportunities  for 
managers  in  systems  acquisition  and  logistics  or  the 
functional  areas  of  maintenance,  supply  and  prccu 
.  .  .  .  The  objective  result  is  a  more  kr.cwledgea 
group  of  systems  and  logistics  managers  .  .  .  [1:11L]. 

A  wide  variety  of  personnel  fake  advantage  cf  'he 
numerous  continuing  education  programs.  Members  cf  the 
States  Air  Force,  Army,  Navy,  Marines,  civilian. 


United 


rv 


corps,  as  well  as  specially  selected  allied  officers, 
learn  new  professional  skills  or  update  old  ones  (1:111-). 

~:i ithir.  the  Air  Force,  the  majority  of  students  corr.e  from 
the  Air  Force  Logistics  Command  (AFLC)  and  the  Air  Force 
Systems  Command  (AFSC).  To  meet  the  challenge  of  properly 
educating  its  students  in  its  diverse  continuing  education 
courses,  AFIT  uses  both  a  permanent  faculty  and  a  variety 
of  guest  lecturers  to  teach  resident  and  nonresident 
courses . 

As  indicated  a’ccve,  over  7000  students  attended 
FOE  resident  courses  at  bright -Patterson  in  fiscal  year 
(FT)  79.  The  same  number  of  students  is  scheduled  to  com¬ 
plete  similar  in-residence  courses  during  FYSO  (2:1).  These 
courses  are  typically  from  three  days  to  ten  weeks  in 
length.  Students  arrive  from  all  over  the  -world  and  re¬ 
ceive  instruction  for  six  to  seven  hours  per  day,  five  days 
a  week.  Each  course  is  structured  to  present  the  maximum 
relevant  material  in  the  minimum  time  possible.  This  ap¬ 
proach  provides  students  with  the  most  up-to-date  informa¬ 
tion  available  in  a  specific  area  while  minimizing  the 
actual  time  students  are  absent  from  their  duty  stations  (6). 

nonresident  Professional  Continuing  Education 
courses  covering  a  variety  of  subjects  are  also  offered. 

This  allows  students  the  opportunity  to  be  exposed  to  mana¬ 
gerial  theory,  techniques,  and  application  without  leaving 
their  home  stations.  Among  the  various  instructional 
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techniques  available  for  this  form,  of  PCE,  AFIT  uses  semi¬ 
nars,  workshops,  on-site  offerings  at  the  students'  lo¬ 
cation,  and  correspondence  courses.  The  overall  non¬ 
resident  program  graduated  approximately  10,000  students  in 
FY79  (2:1)  .  In  FY80  these  figures  should  start  increasing 
dramatically  due  to  the  initiation  of  new  teaching  metho¬ 
dologies  . 

This  increase  in  student  throughput  is  AFIT ' s 
response  to  an  increasingly  complex  and  frustrating  prob¬ 
lem.  The  PCE  nonresident  program  began  as  an  attempt  to 
reach  and  teach  the  large  number  of  supervisors  and  mana¬ 
gers  in  the  field  v;hc  are  not  able  to  attend  a  resident 
course.  However,  despite  the  educational  efforts  of  both 
the  resident  and  nonresident  PCE  programs,  the  School  of 
Systems  and  Logistics  is  unable  to  meet  the  demands  placed 
on  it  for  more  classes,  a  greater  variety  of  programs,  and 
a  more  flexible  approach  to  teaching  mere  students  while 
holding  the  line  on  per  pupil  and  total  cost.  Numerous 
resident  courses  within  the  Logistics  FCE  program  cur¬ 
rently  have  a  two-  to  three-year  backlog  of  personnel  re¬ 
quirements.  These  additional  personnel  cannot  be  absorbed 
into  the  resident  program  due  to  a  limited  number  of  class¬ 
rooms,  study  facilities,  faculty,  and  funds.  Further,  it 
costs  the  government  more  each  year  tc  have  a  person 
attend  an  in-residence  school  in  terms  of  travel  expenses, 


loss  of  that  person's  skills  at  his/her  hone  station,  and 
per  diem  (2:1;  2).  Finally,  AFIT  has  received  a  large 
number  of  requests  to  develop  new  courses  for  Air  Force 
and  other  DCD  agencies,  thereby  increasing  the  strain  on 
the  system  even  more  (10:3). 

To  resolve  these  problems,  personnel  from  the  AFIT 
School  of  Systems  and  Logistics  investigated  a  number  cf 
concepts  and  programs  currently  being  used  by  civilian  in¬ 
stitutions  in  the  field  cf  education  delivery  systems 
(10:1).  Several  state  and  private  higher  education  in¬ 
stitutions  were  questioned  on  new  techniques,  practices, 
and  breakthroughs  in  the  area  cf  electronic  education. 
Eventually  the  search  focused  on  telephonic  networking,  and 
from  this  the  system  known  as  the  AFIT  Teleteach  Expanded 
Delivery  System  (TEDS)  was  developed.  As  the  word 
"Teleteach"  implies,  the  core  of  this  instructional  method 
is  the  telephone . 

Because  AFLC  and  AFSC  are  the  primary  users  of  the 
FCE  program,  and  because  the  majority  of  their  personnel 
are  located  in  a  small  number  of  centralised  activity  cen¬ 
ters  (depots  and  divisions,  respectively),  they  seemed 
the  logical  beneficiaries  of  any  improvements  made  to  the 
program.  Therefore,  they  agreed  to  share  the  cost  cf  the 
new  TEDS  (2:3)-  Consequently,  the  first  two  telephonic 
networks  installed  connected  AFIT  (  at  'bright -Patterson  AFr 


with  the  five  AFLC  Air  Logistic  Centers  (ALCs)  and  with 
ohe  four  primary  AFSC  locations.  These  nine  remote  sites 


are  geographically  dispersed  throughout  the  United  States. 
Each  telephone  network  consists  of  two  pairs  of  dedicated 
telephone  lines  which  connect  the  "home"  classroom  with  all 
the  remote  sites.  One  pair  of  lines  sends  and  receives 
verbal  transmissions  while  the  other  pair  transmits  -writ¬ 
ing  generated  upon  an  electronic  blackboard,  a  device  manu¬ 
factured  by  American  Telephone  and  Telegraph  (2:2).  This 
instrument  is  used  by  the  instructor  much  as  a  normal 
blackboard.  However,  the  wcrds  or  computations  placed  on 
this  board  are  digitised,  transmitted  over  telephone  lines, 
then  reproduced  on  television  monitors  at  the  remote 
site  classrooms.  It  should  be  noted  that  the  television 


displays  only  what  is  -written  or.  the  electronic  blackboard. 


It  is  not  a  source  of  student-to-teacher  or  teacher-tc- 
student  video  (i.e.,  the  students  and  teachers  can  only 
hear,  net  see,  each  other).  Cral  communication  is  accom¬ 
plished  via  microphones  located  at  students’  desks  and  at 


the  instructor’s  position. 

Because  each  site  has  the  capability  to  transmit 
as  'well  as  receive  (via  these  two  rains  of  dedicated  lin 
presentations  car.  originate  at  any  site.  Cf  course,  an 
electronic  blackboard  must  be  available  tc  transmit  vide 
information.  AFLC  arid  AFSC  each  has  its  own  separate  ne 
•work,  thereby  allowing  AFIT  tc  offer  two  courses 


es 


simultaneously.  Colonel  Lewis  M.  Israelitt,  Dean  of  the 
School  of  Systems  and  Logistics,  points  out  that,  via  TEDS, 
his  faculty  can  teach  as  many  as  six  classrooms  of  students 
at  the  same  time  for  AFLC  (one  at  Wright -Patterson  and  one 
at  each  of  the  ALCs)  and  five  for  AFSC  (one  at  Wright- 
Fatterson  and  one  at  each  division) ,  thereby  educating  as 
many  as  four  to  five  times  as  many  students  as  are  possible 
in  the  resident  program  (10:3-^)* 

The  school  chose  this  system  for  several  reasons. 
First,  the  use  of  telephonic  instruction  is  not  entirely 
foreign  to  AFIT.  Starting  in  1973.  the  School  of  Civil 
Engineering  and  the  School  of  Systems  and  Logistics  each 
conducted  one-  to  two-hour  classes  by  telephone.  Coordi¬ 
nation  requirements  were  simpler  under  this  program.  When 
a  base  requested  instruction  on  specified  topics,  AFIT  sent 
out  a  packet  of  materials  consisting  of  slides  or  view- 
graphs  and  a  course  outline.  At  a  mutually  agreed-upon 
time,  a  faculty  member  conducted  the  class  by  telephone 
(3:89).  Though  this  program  was  much  more  primitive  and 
limited  than  the  TEDS  methodology,  it  did  provide  AFIT 
with  a  conceptual  and  practical  background  in  the  tele- 
teach  system  (6).  Second,  numerous  civilian  institutions 
have  incorporated  some  form  of  telephonic  instructional 
networks  into  their  methodology  for  years.  During  their 
research,  AFIT  personnel  discovered  that  use  of  such  deli¬ 
very  systems  has  been  increasing  in  the  civilian  sector 
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since  the  early  1960s.  As  of  this  tine,  approximately  37 
universities  and  colleges  use  telecommunications  as  a 
regular  method  of  instruction  for  students  who  are  remote 
from  the  originating  classroom  (2:2).  Although  schedules 
vary,  the  majority  of  civilian-conducted  telephonic  net¬ 
work  instruction  is  given  in  one-  or  two-hour  tlccks  and 
occurs  once  or  twice  a  week.  Most  network  areas  are  re¬ 
stricted  to  specific  state  or  geographic  parameters. 

The  University  of  Wisconsin,  with  its  fourteen- 
year-old  Educational  Telephone  Network  (ETN),  is  considers' 
the  civilian  university  leader  in  teleteach  related  in¬ 
struction.  Recently  in  one  year  alone  this  school  had 
almost  2E,0C0  participants  in  1000  ETN  programs  (19:15-16) 
Other  major  institutions  such  as  the  Virginia  Polytechnic 
Institute,  the  University  of  Illinois,  and  Kansas  State 
University,  incorporated  the  teielecture/teleteach  de¬ 
livery  methodology  in  teaching  undergraduate-  and  masters- 
level  programs.  Each  school  mentioned  has  evaluated  its 
particular  methodology  and  concluded  that  telephonic  net¬ 
work  instruction  is  as  effective  a  learning  methodology 
as  is  the  traditional  classroom  instruction  (9:73;  5:5-6; 

20 : 66)  . 

Telephonic  instructional  networks  are  currently 
used  to  provide  continuing  education  for  legal,  medical 
and  agricultural  specialists  as  well  as  for  students  in 
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and  mathematics.  Thus  far  the  telelecture/teleteach 
methodology  has  not  been  found  inappropriate  for  any  of 
the  disciplines  taught  via  this  technique  (19:2;  15:20). 

It  is  important  at  this  juncture  to  clarify  several 
definitional  points.  A  variety  of  terms  are  used  by  a 
number  of  authors  to  focus  on  one  element  in  a  family  of 
instructional  delivery  systems;  viz.,  the  terms  TEDS, 
teleczure,  telelecture,  teleteach,  telephonic  delivery, 
and  telephonic  network  instruction  all  relate  to  a  type 
system  wherein  a  telephone  line  (or  paired  lines)  is  used 
to  transmit  instructional,  educational  material  from  one 
"home"  site  to  one  or  more  remote  sites  and  return  imme¬ 
diate  oral  feedback  from  the  students.  For  purposes  of 
definition,  the  last  two  terms  are  generic  in  scope,  en¬ 
compass  any  instructional  delivery  system  utilizing  one  or 
more  telephones,  and  may  or  may  not  include  one  of  several 
electronic  devices  which  provide  video,  as  well  as  oral, 
communication  capability  to  the  system.  The  terms  "tele- 
lecture”  (or  "telecture")  and  "teleteach"  are  basically 
synonymous  today,  though  there  were  some  distinctions 
between  "hem  when  they  originated  during  the  1950s  and 
1960s,  respectively.  In  particular,  the  concept  cf  tele¬ 
lecture  for  college-level  academics  began  at  the  Univer¬ 
sity  of  Illinois  Chicago  Medical  Campus  in  late  192-7. 

From  there  this  idea  of,  literally,  "lectures  by  tele- 
gained  popularity  at  many  educational  levels. 
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Typically,  the  telelecture  system  was  used  for  shore- 
term  seminars  or  one-time  projects  (15sl£,  19)-  Then 
in  the  1960s  another  type  of  telephonic  delivery  system, 
originated.  This  method,  known  as  teleteach,  differs 
from  telelecture  in  that  teleteach  is  implemented  'ey  a 
teacher  cr  course  director  on  a  continuous  basis  tc  teach 
regular  curriculum  to  students  removed  from  the  main 
school  facilities.  Also,  the  teleteach  instruction  can 
be  accomplished  ax  the  same  time  the  teacher  is  instruct¬ 
ing  a  "home"  class.  This  contrasts  with  telelecture, 
which,  as  indicated  above,  is  not  usually  conducted  cr. 
a  continuous  basis  and  is  usually  used  as  a  supplement  'ey 
the  "heme"  teacher  (15*.  19)  •  Though  these  two  methods  are 
still  distinguishable  today,  the  terms  describing  them 
are  used  interchangeably  by  many  authors  cr.  this  topic. 

The  Teleteach  Expanded  Delivery  System  (TEDS'  metho: 


cf  instruction  is  an  AFIT  variation  of  the  mere  general 
teleteach  system.  As  discussed  earlier,  the  TEDS  incorpo¬ 
rates  a  television  monitor  to  reproduce  written  video  dat: 
corresponding  to  that  which  is  placed  cr.  the  electronic 
blackboard.  Other  of  the  above-mentioned  systems  may  use 
a  device  known  as  an  Electrcv/rit er  in  lieu  cf  the  elec¬ 
tronic  blackboard.  The  basic  Electrcwriter  svstem  came 


into  being  in  the  early  I960; 
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ing  assemblies:  a  transmitter,  a  receiver,  twe  telephone 


lines,  and  two  data  phones .  - c t h  the  r 


transmitter  have  a  writing  area  of  approximately  17-1/2 
square  inches.  As  the  writer  at  one  end  moves  the  pen  on 
his  paper,  a  pen  at  the  receiving  end  reproduces  the  mes¬ 
sage,  which  is  then  (typically)  projected  onto  a  larger 
screen  via  an  attached  overhead  projector  (15:20) .  3y 
incorporating  the  electronic  blackboard  (with  its  greater 
versatility  due  to  larger--3-l/2'  x  b-l/2'--writing  space) 
into  the  TEDS  instead  of  the  older  Electrowriter,  AFIT 
decided  to  use  one  of  the  most  current  telephonic  instruc¬ 
tional  delivery  systems  available. 

The  Air  Force  Institute  of  Technology  initiated 
TEDS  ax  Wright-Patterson  AFB  in  October  1979  via  a  two- 
phased  pilox  program  encompassing  four  Professional  Con¬ 
tinuing  Education  courses:  LOG  220  (AFLC  Materiel 
Management) j  SYS  223  (Program  Management) ;  SYS  326  (Funda¬ 
mentals  of  Acquisition  Management) ;  and  QMT  170  (Princi¬ 
ples  of  Contract  Pricing) .  The  first  phase  involves  only 
one  course--L0G  220--which  had  four  separate  offerings 
in  the  June  through  November  1979  time  period.  Fhase  Two 
involves  all  four  courses,  each  with  several  different 
offerings.  Contrary  to  the  typical  civilian  university 
telelecture  schedule  mentioned  above,  the  AFIT  TEDS  in¬ 
struction  lasts  four  hours  a  day,  five  days  a  week  (3:89). 

The  LOG  220  course  is  the  first  program  to  collect 
comparison  data  under  both  the  nonteleteach  and  teleteach 
environment.  The  June  and  July  offerings  of  this  course 


were  conducted  as  standard  in-residence,  nonteleteach 
classes.  The  September  class  incorporated  teleteach  equip¬ 
ment  (microphones  and  electronic  blackboard)  but  did  not 
.•include  transmission  to  remote  sites.  However,  the  class 
conducted  from  10  October  1979  to  16  November  1979  used 
the  total  TEDS  system.  This  class  simultaneously  in¬ 
volved  students  in  the  home  classroom  at  Wright -Patterson 
as  well  as  students  at  each  of  the  five  ALCs.  Whether  it 
was  presented  in  the  TEDS  or  ncnTEDS  format,  the  purpose 
of  the  course  was  the  same,  that  is: 

.  .  .  to  improve  the  management  effectiveness  of 
key  personnel  assigned  to  the  materiel  management 
and  related  AFLC  activities  which  provide  support  to 
the  Air  Force  and  other  DOD  agencies.  The  course  is 
intended  to  familiarise  the  student  with  the  structure, 
philosophy,  policies,  functions,  processes,  and  sub¬ 
systems  of  Air  Force  logistics,  particularly  their 
impact  on  the  Directorate  of  Materiel  Management  (MM) 
[1:115]- 

Students  in  LOG  220  usually  range  in  military  grade 
from  02  through  06  and  in  civilian  grade  from  G3-11  through 
GS-14.  The  curriculum  is  taught  using  lecture,  lecture- 
discussion,  and  system  management  simulation  exercise  for¬ 
mats  . 


Problem  Statement 

A  requirement  exists  within  the  Air  Force  Institute 
of  Technology  for  an  evaluation  of  the  recently-implemented 
TEDS  method  of  group  instruction.  This  evaluation  focuses 
on  (1)  the  cost  effectiveness  of  this  method  per  student; 
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as  compared,  to  that  of  the  in-resident,  one  instructor- 
one  class  method  of  instruction,  (2)  the  effectiveness  of 
the  TEDS  method  from  an  educational  point;  of  view,  and  (3) 
the  acceptability  of  this  new  delivery  method  by  students 
and  faculty.  Because  LOG  220  is  the  first  course  from 
which  comparative  data  on  nonteleteach  and  teleteach 
methodologies  are  available,  the  July  and  October  offerings 
form  the  basis  of  this  evaluation.  (The  June  and  September 
classes  were  excluded  from  this  study  due  to  insufficient 
data  and  only  partial  implementation  of  the  new  methodology, 
respectively . ) 


Justification 

By  initiating  a  TEDS  instructional  methodology  in 
selected  courses  within  its  Professional  Continuing  Educa¬ 
tion  portion  of  the  School  of  Systems  and  Logistics,  AFIT 
established  the  correlative  need  to  evaluate  this  new  pro¬ 
gram  to  determines  (1)  the  viability  of  this  concept  in 
the  total  AFIT  educational  environment;  and  (2)  the  desira¬ 
bility  of  expanding  the  use  of  this  system  to  other  PCE 
courses.  Specifically,  prior  to  committing  additional 
funds,  physical  resources,  and  faculty  and  administrative 
capabilities,  AFIT  decision-makers  must  be  more  cognizant 
of  this  system's  impact  in  several  areas.  First,  the  cost 
effectiveness  of  TEDS  as  compared  to  the  current  in¬ 
residence  program  must  be  established.  If,  on  a  per  student 
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basis,  this  new  method  does  not  produce  cost  reductions, 

AFIT  cannot  justify  the  required  expenses  of  the  system. 
Second,  AFIT  leaders  feel  that  they  have  a  professional 
obligation  to  maintain  AFIT 1 s  reputation  for  a  high  quality 
of  education  in  all  its  education  programs.  The  TEDS 
method  must  be  evaluated  in  terms  of  its  effectiveness, 
viz.,  is  the  student  gaining  as  much  knowledge  under  tele- 
teach  as  he  or  she  might  have  under  the  in-residence  ap¬ 
proach?  The  third  area  which  must  be  evaluated  centers  on 
acceptability.  If  the  students  do  not  accept  the  TEDS  ap¬ 
proach  to  instruction  because  they  feel  uncomfortable  with 
it  or  because  they  do  not  feel  they  are  acquiring  the 
requisite  knowledge  from  the  course,  AFIT ' s  efforts  to  edu¬ 
cate  more  people  in  a  more  rapid  manner  may  be  ineffective. 
Also,  if  the  participating  faculty  members  reject  this  as 
a  legitimate  delivery  system,  the  program  as  constructed 
could  be  seriously  compromised  and  may  have  to  be  re¬ 
evaluated  and  either  revised  or  discarded.  These  major 
areas  must  each  be  rigorously  evaluated  by  an  impartial 
body  before  AFIT  leaders  can  lock  to  TEDS  both  as  an  accept¬ 
able  solution  to  their  perceived  problems  and  as  the  impetus 
for  greater  educational  expansion  and  flexibility. 

Objectives 

To  determine  the  cost  effectiveness  of  implementing 


he  TEDS  approach  within  the  LCC-  220  course. 


To  determine  the  effectiveness  of  learning  using 
the  TEDS  approach  for  LOG  220. 

To  determine  the  acceptability  of  the  TEDS  ap¬ 
proach  to  the  LOG  220  students  and  faculty. 

Hypotheses 

The  TEDS  approach  used  in  the  LOG  220  course  is 
less  costly  per  student  than  the  in-residence  method  of 
instruction  for  the  same  course. 

Learning  via  the  TEDS  approach  is  as  effective  as 
learning  by  the  in-residence  method  of  instruction  in  the 
LOG  220  course.  Effectiveness  in  the  context  used  here 
would  be  established  if  there  is  no  statistically  signifi¬ 
cant  difference  between  TEDS  and  nonTEDS  test  scores. 

The  TEDS  method  of  delivery  used  in  LOG  220  is 
acceptable  to  participating  faculty  members. 

Students  enrolled  in  LOG  220  consider  the  TEDS  an 
acceptable  instructional  delivery  system. 


15 


CHAPTER  II 


LITERATURE  REVIEW 

A  large  number  of  professional  educators  have  ex¬ 
amined  the  telephonic  method  of  instruction  delivery  in 
terms  of  its  relative  success.  A  review  of  literature  re¬ 
veals  a  variety  of  attempts  to  quantify  and  evaluate  the 
results . 

Writing  in  Adult  Leadership,  Lily  Edelman  discussed 
reasons  for  requiring  innovative  teaching  systems  which 
parallel  the  requirements  at  the  Air  Force  Institute  of 
Technology.  One  of  these  reasons  is  the  shortage  of  quali¬ 
fied  instructors  necessary  to  provide  educational  oppor¬ 
tunities  to  all  those  desiring  them.  In  Ms  Edelman' s  case, 
there  is  a  shortage  of  qualified  teachers  (8:163);  but  the 
AFIT  shortage  occurs  primarily  because  of  budgetary  limita¬ 
tions  (2).  In  both  situations,  the  net  result  is  a  serious 
backlog  of  people  interested  in  receiving  additional  learn¬ 
ing  opportunities  (6;  8:163). 

One  test  program  described  by  Ms  Edelman  centered 
on  a  telelecture  class  in  Hebrew  which  was  created  to  meet 
the  needs  of  a  large  group  of  adult  students  spread  over 
a  substantial  area  (Chicago,  Illinois,  Grand  Rapids  and 
East  Lansing,  Michigan) .  The  specific  system  used  was  the 
teleiecture-plus-Electrowriter  technique  described  in 
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Chapter  I  of  this  paper.  This  program  included  the  es¬ 
tablishment  of  an  appropriate  control  group.  The  ensuing 
results  were  favorable  with  the  achievement  level  of  both 
the  control  group,  which  had  in-residence  instruction,  and 
the  remote  groups,  taught  by  telelecture,  being  comparable. 
In  addition,  the  remote  group  considered  the  learning  en¬ 
vironment  a  pleasant  situation  (3:l64).  Similarities  be- 
xween  Ms  Edelman's  study  and  the  present  study  include  the 
use  of  adult  education  groups  being  taught  by  either  in¬ 
residence  methods  or  telelecture. 

A  minor  difference  occurs  with  particular  equip¬ 
ment  used.  The  AFIT  system  uses  an  electronic  blackboard 
instead  of  an  Electrcwriter ;  however,  the  opportunity  for 
two-way  communication  exists  using  either  transmission  de¬ 
vice.  The  conclusions  reached  by  Ms  Edelman  are  supportive 
of  hypotheses  generated  within  the  current  study,  i.e.s 

1.  Instruction  received  by  way  of  telephonic  de¬ 
livery  systems  (in  this  case,  telelecture  plus  Electro¬ 
writer)  can  be  as  successful  as  the  in-residence  methods 
of  instruction. 

2.  This  system  provides  an  excellent  opportunity 
to  simultaneously  share  the  talents  of  guest  speakers  by 
a  number  of  students  in  different  locations  (8:l64). 

Professor  Dotterweich,  in  his  article  in  Audio¬ 
visual  Instruction,  has  taken  a  close  look  at  the  variables 


he  feels  are  necessary  to  improve  the  effectiveness  of 
teaching  remote  classes.  Although  his  primary  concern  is 
teaching  with  the  use  of  video  tape  recordings,  many  of 
his  ideas  appear  applicable  to  the  effective  use  of  the 
telephonic  network  approach  (7*39) -  A  prime  responsibility 
of  the  instructor  has  always  been  adequate  preparation  of 
his  subject  matter;  however,  when  remote  teaching  is  taking 
place  this  aspect  is  extremely  important  (7*^2).  Because 
of  the  lack  of  face-to-face  contact,  the  greatest  challenge 
to  the  instructor  is  to  retain  the  students'  attention  and 
impart  that  level  of  knowledge  that  is  desired  for  the 
students  to  gain  (7:42).  Professor  Dotterweich  concludes 
that  the  use  of  visual  aids  as  supplements  to  the  lesson 
will  help  the  student  continue  to  feel  as  though  he  were 
right  there  in  the  classroom  with  the  instructor. 

As  implied  above,  the  availability  of  a  medium  for 
feedback  to  the  instructor  is  essential  for  an  effective 
remote  learning  system  (7:42).  Questionnaires  distributed 
by  Professor  Dotterweich  surveyed  attitudes  toward  remote 
teaching,  and  results  indicated  good  acceptability  of  the 
medium  as  long  as  there  was  the  opportunity  for  instant 
feedback  (7:42).  This  opportunity  does,  of  course,  exist 
in  the  AFIT  TEDS  in  the  form  of  the  remote  classroom  micro¬ 
phones  . 

The  University  of  Wisconsin  has  been  an  active  user 
of  the  telephonic  delivery  mode  of  instruction  in  the 


continuing  education  of  health  professionals  (4:208). 

Arndt  and  Weinswig  present  their  analysis  in  the  American 
Journal  of  Pharmaceutical  Education.  They  support  the  con¬ 
tention  that  telephonic  instruction  is  a  viable  means  cf 
communicating  knowledge .  The  acceptability  of  the  Univer¬ 
sity's  program  is  most  notably  shorn  by  a  substantial  in¬ 
crease  in  enrollment  in  telephonic  courses  over  a  five- 
year  period.  Specifically,  the  number  of  enrollees  in¬ 
creased  from  267  in  the  spring  of  1963,  to  426  in  the  fall 
of  1972  (4:213) . 

Some  differences  do  exist,  however,  in  the  overall 
Wisconsin  program  and  the  AFIT  program  which  could  distin¬ 
guish  Wisconsin's  results  from  those  of  AFIT.  The  partici¬ 
pants  in  the  Wisconsin  program  were  all  voluntary,  whereas 
AFIT  continuing  education  students  are  normally  selected 
to  attend  to  better  prepare  them  to  fulfill  their  roles  as 
government  employees  (1:203;  2).  Consequently,  a  measure¬ 
ment  of  class  attendance  and  enrollment  increase  or  de¬ 
crease  would  not  serve  any  useful  purpose  for  our  study. 

Some  differences  in  presentation  also  are  present. 
The  authors  found  that  a  single  lecturer  for  a  course  pro¬ 
vided  greater  continuity;  however,  AFIT  continuing  education 
courses  are  structured  toward  multiple  instructors  and 
frequent  use  of  guest  speakers  who  are  experts  in  their 
areas  of  endeavor  (4:210;  2). 
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A  number  of  authors  have  focused  on  the  impact 
that  attitude  has  on  the  success  or  failure  of  educational 
delivery  systems  similar  to  TEDS.  Attitude  as  used  here 
relates  to  two  sets  of  individuals--the  students  and  the 
instructors.  Regardless  ox  how  intrinsically  good  an 
educational  system  might  be,  it  must  be  accepted  by  the 
students  as  a  viable  instructional  methodology  or  they  will 
(intellectually)  turn  their  tacks  to  it.  Similarly,  if 
the  instructors  feel  chat  the  method  is  invalid,  they  will 
probably  not  support  it.  In  either  case,  the  potential 
results  are  the  same:  the  desired  information  will  net  be 
received  by  the  student,  ar.d  the  overall  effectiveness  of 
the  delivery  system  will  be  minimal  or  nonexistent . 

A.  A.  Reid,  in  Human  Factors,  discusses  various  at- 
titudinal  factors,  such  as  how  different  age  groups  may 
have  divergent  attitudes  toward  various  telecommunications 
devices  used  to  impart  knowledge.  Their  attitudes  may  de¬ 
termine  (to  a  great  extent)  the  effectiveness  of  the  in¬ 
struction  (16:453)*  This  concept  is  the  primary  motiva¬ 
tion  for  comparing  student  attitudes  about  TEDS .  As 
stated  by  the  author: 

Thus,  the  possibility  of  substituting  [telephonic 
instructional  techniques]  .  .  .  for  face-to-face  meet¬ 
ings  will  be  affected  by  the  readiness  of  users  tc 
forego  the  peripheral  niceties  of  hospitality  which 
the  face-to-face  meeting  affords  [16:453]. 

An  area  that  contributes  greatly  mo  a  roter.tial 
lack  of  effectiveness  using  the  telephonic  delivery  system 


is  discussed  by  Ruth  i/einstock  in  Planning  for  Higher  Educa¬ 
tion  .  This  area--instructcr  resistance  tc  accepting  a  sys¬ 
tem  that  utilises  the  telephone--can  be  overcome  if  properly 
anticipated  and  prepared  for  by  the  implementing  agency. 
Prime  causes  of  instructor  resistance  or  rejection  of  this 
approach  appear  to  be  linked  tc  the  instructor's  perceptions 
about  how  well  his  presentation  is  being  cr  will  be  re¬ 
ceived.  IVI any  instructors  do  not  want  tc  change  their  in¬ 
structional  delivery  method  and  soon  discover  that  customary 
approaches  will  not  work  with  remote  audiences  ( 19s 1 S  —  1 9 
The  present  study  looks  closely  at  instructor  attitudes  in 
terms  of  its  potential  impact  on  success  (effectiveness)  cf 
TEDS  . 

Rac  and  Hicks  wrote  an  interesting  article  for 
Audiovisual  Instruction  which  reviews  the  history  cf 
telephone-based  instructional  systems  and  purports  tc 
identify  some  cf  the  advantages  realised  by  using  the  tele¬ 
phonic  instructional  delivery  system.  The  authors  suggest 
a  method  to  estimate  costs  of  establishing  a  telephonic 
network  which  includes  the  followings  equipment  rental; 
installation;  and  average  cost  per  long  dis~ar.ee  call 
(15*1-) •  Although  this  constitutes  a  valid  start  for  esti¬ 
mating  costs,  this  paper  will  go  into  much  gr?a~er  detail 
in  identifying  the  expenses  entailed  ir.  developing  the 
TEDS.  The  specific  data  used  ~c  ccr.cs.re  the  TEDS  and 


r.cn.uub  costs  are  m  me  next  cnaote: 


. . .  WIHll.i. 


The  articles  cited  here  constitute  a  representative 
cross  section  of  the  extensive  literature  dealing  with  the 
telephonic  method  of  delivery  instruction.  Although  the 
authors  presented  address  their  comments  to  a  variety  of 
specific  professional  audiences,  several  major  concepts 
emerge.  First,  as  expressed  by  Sdelnan,  the  telephonic 
delivery  system  appears  to  be  a  viable  solution  to  the  con¬ 
flict  between  high  demand  for  education  and  low  resource 
availability.  Second,  Zdelman,  Doth erweich,  Arndt  and 
Weinswig,  beinstock,  and  Reid  all  contend  that  attitude-- 
both  student  and  instructor  attitude--will  determine  hew 
effective  this  type  of  system  is.  Third,  many  evaluators, 
including  Sdelman  and  others  cited  throughout  this  study, 
have  tested  the  learning  effectiveness  of  this  delivery 
system  as  a  basis  for  determining  overall  effectiveness. 
Fourth,  the  other  major  measure  of  effectiveness  used  by 
authors  such  as  Rac  arid  Hicks  focuses  on  the  cost  cf  this 
type  of  system  as  compared  to  the  in-residence  methodology . 
This  comparison  is  exceptionally  relevant  to  AFIT ' s  TEDS 
in  light  cf  the  Air  Force's  limited  resources  and  its  de¬ 
sire  to  realise  maximum  benefit  from  each  dollar  spent  for 
education,  kith  these  concepts  in  mind,  it  is  necessary 
to  develop  a  methodology  comprehensive  enough  to  fully 
evaluate  TEDS. 
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CHAPTER  III 


METHODOLOGY 


Introduction 

This  chapter  w as  designed  to  develop  the  metho¬ 
dology  used  in  evaluating  the  effectiveness  of  the  TEDS 
instructional  program.  Effectiveness  was  based  on  a  com¬ 
parison  of  TEDS  and  ncnTEDS  programs  and  was  viev/ed  from 
three  different  perspectives:  cost  effectiveness,  learn¬ 
ing  improvement,  and  acceptability  (by  students  and 
instructors) .  The  chapter  begins  with  a  discussion  of  the 
universe,  population,  and  sampling  plan.  Next  the  data 
collection  process  for  each  of  the  three  areas  is  described. 
The  chapter  continues  with  an  explanation  of  the  major 
statistical  tests  conducted  on  the  data  and  the  descriptive 
statistics  used  in  classifying  the  data.  Then  criteria 
tests  (decision  rules)  were  established  tc  determine  signi¬ 
ficance  of  analysis  results.  The  chapter  ends  with  the 
set  of  assumptions  necessary  to  permit  use  of  the  specific 
statistical  tests. 
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Universe  and  Peculation 
The  universe  included  ail  civilian  and  mi 
1  whe  were  assigned  tc  the  Air  Force  legi 
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Command  and 
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Continuing  Education  courses.  Historically,  the  AE1C 
headquarters  (located  at  V/right -Patterson  A53,  Ohio)  and 
each  cf  the  Air  Losistics  Centers  independently  determine 


which  students  wrill  'ce  selected  from  among  those  eligible 
tc  attend  both  the  in-residence  and  remote Iv  taught  AEIT 


FCE  courses.  Air  Logistics  Centers  participating  in  the 
initial  TEDS  program  are  located  at: 

1.  Ogden,  Utah  (OCALC) 

2.  Oklahoma  City,  Oklahoma  (CCA1C) 

3.  Sacramento,  California  (SMALC) 

4.  San  Antonio,  Texas  (SAALC) 

5 .  Warner-?. obins ,  Georgia  ( VJP.ALC ) 

The  population  cf  interest  consisted  cf  all  these 
personnel  eligible  for  participation  in  the  FCE  courses 
who  were  also  eligible  for  enrollment  in  the  LCG  220 
course.  Also  included  within  the  population  of  study  are 
AEIT  faculty  and  guest  instructors. 


Samolinm  Flan 


A  convenience  sample  of  students  who  were  enrolls 
one  LCG  220,  Materiel  Management  course,  between  1  Jui 


and  30  November  1979,  was  selected. 
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sufficient  data  available  tc  compare  ncnTZDS,  re  si 


?EDS ,  and  remote  TEDS  classes.  The  grout  of  2; 
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completing  LCG  220  in  class  79E  during  the  summer  cf  1979 
in  residence  at  r i sht -Pat t e r s on  AEB  was  established  as 


the  ncnTEDS  control  class 


T’ri0  24  student s  utn endins*  th. 
LCG  220  course  at  AFIT  during  the  October-llcvember  1979 
offering  were  designated  the  resident  TEDS  class  and  vver 
an  integral  part  of  class  SCAT.  The  remaining  students 
in  class  60AT  were  located  at  their  respective  Air  Logis 
tics  Centers  and  were  designated  the  remote  TEDS  classes 
The  cor/cined  resident  TEDS  class  and  remote  TEDS  classes 
constituted  the  overall  TEDS  class. 

Selection  of  students  for  a  particular  class  was 
accomplished  by  the  applicable  ALC/Kc  AFLC  unit  and  was 


assumed  to  have  been  random.  There  were  nc  Known  biasir. 
variables  operating  in  student  selection  for  any  cf  the 
classes  included  in  the  study. 

Instructors’  attitudes  toward  TEDS  were  limited 
to  those  instructors  teaching  class  SCAT  because  they  we 
the  first  instructors  to  fill  out  critiques  of  the  TEDS. 
Most  of  these  instructors,  however,  had  taught  the  LCG-  2 
course  prior  to  implementation  of  TEDS,  so  they  had  ex¬ 
perience  in  both  teaching  methods. 

Cost  data  applicable  only  to  students,  equipment 
specific  TEDS  materials,  supplies,  and  support  personnel 
associated  with  LCG  220  were  considered. 


Data  Collection 

Student  and  instructor  data  were  collected  using 
standard  answer  sheet  A,  Optical  Scanning  Form  DS1120-A. 


Fost-test  Scores 


The  percentage  of  total  correct  ansv/ers  on  three 
quizzes  developed  by  the  course  director  and  administered 
periodically  throughout  the  duration  of  the  course  v/ere 
compiled.  This  figure  was  used  as  a  basis  for  com¬ 
parison  between  the  ncnTEDS,  resident  TEDS,  and  remote 
TEDS  classes.  In  constituted  a  determinant  of  the  learn¬ 
ing  effectiveness  of  TEDS. 

Student  Attitudes 

Student's  perceived  learning  and  acceptability  of 
TEDS  were  ascertained  through  use  of  a  student  end- of - 
course  critique  (Appendix  B).  Questions  or  statements 
from  the  critiques  which  pertained  to  the  LCG  220  course 
and  which  were  evaluated  in  our  study  were  as  follows: 

1.  The  course  objectives  were  made  clear  either 
orally  or  in  the  instructions. 

2.  The  course  appeared  well  structured. 

3-  The  course  structure  permitted  questions  to  be 
asked  and  answered  satisfactorily. 


4.  There  should  have  been  more  handout  materials. 
5*  I  will  be  able  to  do  my  job  better  as  a  result 


1.  The  room  was  conducive  to  learning. 

2.  I  liked  the  hours  the  course  was  offered. 

3*  The  teleteach  delivery  system  is  ar.  acceptable 
learning  medium. 

4.  I  would  take  another  course  which  used  this 
delivery  system. 

5.  There  should  be  mere  interact i or.  am.cr.g  the 

sites . 

*6.  The  absence  of  eye  contact  wi'h  "he  instructor 
created  a  learning  barrier/prcblem . 

*7-  The  site  monitor  appeared  knowledgeable  of 
equipment  operation. 

*8 .  The  site  monitor  had  the  room  and  materials 
prepared  for  class. 

*9-  A  different  classroom  should  be  used. 

*  Answered  by  remote  TEDS  students  only 
Responses  to  the  above  questions/statements  were  collected 
using  a  five-point  scale  consisting  of  "strongly  agree", 
"agree",  "neither  agree  nor  disagree",  "disagree",  or 
"strongly  disagree". 


Instructor  Attitudes 

Instructor  acceptability  of  TEDS  was  ascertained 
by  analysis  of  the  instructor  critique  developed  by  A? IT 
(Appendix  C).  Questions  or  statements  evaluated  were  as 


follows : 


r 


1.  Before  using  the  teleteach  system,  I  felt  it 


would  not  be  effective. 


2.  The  teleteach  system  provides  advantages  not 


normally  available . 


3*  Resident  TEDS  students  participated  adequately. 
U.  Remote  TEDS  students  participated  adequately. 

5.  Students  aooeared  to  have  learned  the  material 


ore sent ec . 


6.  I  would  like  to  use  the  teleteach  svster.  aaain, 


7.  I  felt  tin  comfortable  when  I  used  th 


e  te leteacn 


system, 


.  Students  do  not  seem  to  learn  well  with  the 


teleteach  system. 


9.  My  inability  to  see  remote  TEDS  students  was 


iisconcerting. 


10.  After  using  the  teleteach  system  I  feel  more 
favorable  toward  its  use. 

Responses  to  the  above  questicr.s/statements  were  collected 
using  a  five-point  Likert  scale  consisting  of  "strongly 
agree",  "agree",  "neither  agree  nor  disagree",  "disagree", 
or  "strongly  disagree". 


Cost  Data 

This  study  evaluated  cost  effectiveness  in  terms  c: 
per  student  expenditures  for  ncnTEDS  students  versus  that 
of  TEDS  students.  Consequently,  the  actual  numbers  of 
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students  involved  in  the  July  nonTEDS  and  October  TEDS 
offerings  were  used.  Further,  because  LOG  220  is  an  A?IT 
course  conducted  for  AFLC  personnel,  the  only  costs  rele¬ 
vant  to  this  research  were  those  incurred  by  these  two 
commands  in  presenting  the  July  and  October  classes.  How¬ 
ever,  in  certain  situations  cost  factors  cited  included 
expenses  incurred  by  AFSC  as  well.  For  instance,  each  of 
the  three  agencies  involved  in  TEDS  (AFIT,  AFLC,  and  AFSC) 
paid  specific  amounts  to  American  Telegraph  &  Telephone 
(AT  &  T)  for  installation  and  monthly  rental  of  circuits, 
equipment,  and  a  bridge  (installed  in  building  641  at 
Wrignt-Patterson  AFB)  for  the  TEDS.  These  costs  were  amor¬ 
tized  when  appropriate  (reference  explanatory  paragraphs 
under  list  of  cost  areas),  and  LOG  220 's  two-month 
share  was  identified.  Of  these,  the  total  nonrecurring 
charges  were  for  installation  of  circuits,  equipment,  and 
the  bridge.  Recurring  costs  consisted  of  rental  of  cir¬ 
cuits,  equipment,  and  the  bridge.  One  additional  recurring 
cost  was  the  surcharge  paid  to  the  Defense  Electronics 
Contracting  Office  for  contract  management  of  the  AT  &  T 
contract.  Rental  costs  of  the  bare  classrooms  were  not 
included  because  the  actual  facilities  used  varied  greatly 
in  overall  utilization  rate  and  age,  thereby  making  any 
such  estimation  too  speculative  for  inclusion. 

The  total  specific  cost  areas  used  to  evaluate 
the  TEDS  LOG  220  course  are  listed  below.  Certain  items 
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are  explained  more  fully  in  the  subsequent  paragraphs. 

1 .  Instructor  wages 

2.  Visual  aids 

3.  Remote  classroom  monitor  wages 

4.  Circuit  installation 

5-  Equipment  installation 

6.  Bridge  installation 

7*  Circuit  rental 

8 .  Equipment  rental 

9.  Bridge  rental 

10.  Classroom  equipment 

11.  Contract  management 

Cost  of  instructor  wages  was  strictly  for  time 
actually  spent  teaching.  Under  both  the  TEDS  and  the  non- 
TEDS  methodologies,  the  same  number  of  classroom  hours 
( 108)  v:as  offered  using  the  same  mix  cf  full-time  ABIT 
instructors  and  guest  speakers  from  other  on-base  agencies. 
Though  it  is  fully  acknowledged  that  the  U.S.  Government 
has  to  ultimately  pay  the  -wages  cf  the  guest  speakers, 
in  neither  case  were  the  guest  speakers  paid  by  A? IT . 
Therefore,  only  the  cost  to  pay  API?  instructors  for  their 
platform  teaching  time  was  relevant  here.  The  restriction 
of  using  only  platform  instruction  time  was  established 
for  several  reasons.  First,  the  researchers  wanted  to 
obtain  the  most  objective  data  available.  The  rlatform 


tine  met  this  criterion  of  objectivity  by  being  readily 
definable  and  observable.  Second,  since  this  '.vas  the  first 
attempt  at  teaching  LCG  220  via  TEDS,  it  was  anticipated 
by  the  researchers  that  instructor  preparation  mime  would 
be  longer  than  in  subsequent  offerings  of  the  same  course. 
This  learning  curve  effect,  though  expected,  could  not  be 
determined  by  only  one  iteration  of  the  TEDS  class.  Third, 
because  no  specific  logs  were  kept  identifying  work  activi¬ 
ties,  the  class'  instructors  could  net  provide  a  definitive 
statement  of  hew  much  time  was  spent  in  preparation  for 
the  course.  There  was  seme  speculation  that  xhe  TEDS 
presentations  took  longer  to  prepare  for,  but  no  substan¬ 
tive  proof  was  found  to  support  this  contention.  As  a 
result  of  these  considerations,  the  researchers  felt  that 
any  attempt  to  specify  costs  in  terms  of  anything  beyond 
simple  platform  instructor  costs  would  be  highly  speculative 
and  unjustifiable  for  purposes  of  this  research.  (There  are 
two  exceptions.  The  course  director  monitored  and  was  paid 
for  the  entire  108-hour  block.  Also  included  is  the 
time  he  and  his  assistant  took  to  prepare  materials,  visual 
aids,  etc.,  for  distribution  to  all  sites.) 

Cost  of  visual  aids  applies  to  these  aids  made 
for  the  WPA73  classroom  plus  five  remote  sites.  Though  the 
course  content  for  both  the  TEDS  and  nonTEDS  classes  are 
the  same,  an  entirely  new  set  of  visual  aids  had  to  be 
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developed  for  the  TEDS  classes  due  to  charges  ir.  instruc¬ 
tional  format  and  procedure.  Visual  aids  initially  de¬ 
veloped  for  TEDS  were  expected  ~c  have  a  IOC  percent  turn¬ 
over  every  three  years.  This  was  due  to  revised  ir.fcrmaticr, 
instructional  modifications,  and  normal  wear  and  tear. 

The  figures  cited  for  the  three  installation  and 
three  rental  areas  sometimes  included  A?SC  costs  to  AT  k  T 
as  well  as  those  from  AEIT  and  AFLC  to  AT  &  T .  In  such 
cases,  6/11  of  the  total  cost  was  attributed  to  AEIT  and 
AELC  based  on  ..EEC's  five  remote  sites,  A.FSC  '  s  four  remote 
sites,  and  AEIT's  two  classrooms.  By  so  dividing  the 
expenses,  any  costs  directly  attributable  to  AEIT  but  shared 
cy  users  from  AELC  and  AESC  were  apportioned  equally. 

Estimated  cost  of  educational  (ncnAT  &  T)  equip¬ 
ment  for  one  AEIT  classroom  and  each  AELC  classroom  was 
established.  Equipment  purchased  specifically  for  the  TEDS 
approach  included  audio  equipment  and  a  stereo  tape  recorder 
for  all  classrooms  and  two  television  monitors  for  the 
WPAEB  classroom.  Remote  sites  already  had  all  other 
required  equipment.  However,  the  authors  felt  that,  to 
more  accurately  depict  all  costs  attributable  to  TEES,  ail 
equipment  used  to  support  the  course  should  ce  included. 
Since  actual  cost  of  on  hand  equipment  was  unknown,  current 
prices  were  assumed,  ar.d  the  equipment  (see  Appendix  Z' 
was  amortised  ever  a  6C  month  period  as  if  if  had  beer, 
newly  our chased. 


were : 


Total  specific  areas  used  to  establish  ncr.TEDS  ocs 

1 .  Instructor  wages 

2.  Visual  aids 

3.  Student  Temporary  Duty  (TDY)  per  diem 

4.  Student  travel  pay 

5.  Classroom  equipment 

In  comparing  the  July  and  October  classes,  the 
home  bases  cf  the  July  students  were  used  in  computing  the 
actual  travel  expenses  incurred  by  A7IT .  Also,  a  stand¬ 
ard  $25  incidental  fee  was  added  to  each  student's  travel 
costs.  This  is  standard  procedure  by  A?IT  Accounting  and 
Finance  personnel  in  order  to  cover  such  items  as  taxi 
fares  to  and  from  airports,  etc. 

The  figure  for  classroom  equipment  includes  all 
classroom  equipment  required  to  conduct  LOG  22C  at  Wright - 
Patterson  AF3 .  Equipment  was  amortised  over  a  60-month 
period  then  multiplied  by  two  fcr  the  course  length. 

As  mentioned  above,  in  certain  areas  it  was  nec¬ 
essary  to  develop  a  series  of  formulae  to  establish  the 
amount  of  an  overall  cost  which  would  be  attributable 
solely  to  the  LOG  220  course.  The  formulae  that  follow 
are  specific  in  nature  but  are  applicable  to  both  the 
unique  offering  of  LOG  220  under  study  as  well  as  to  any 
other  TEDS  course  that  subsequently  may  be  considered  fcr 
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evaluation .  As  a  result,  where  certain  variables  suer,  as 
total  transmission  sine  in  hours  and  octal  circuit  test 
would  normally  be  stated  in  terms  of  total  annual  time  and 
cost,  they  are  here  stated  in  terms  cf  total  system,  life 
(which  amounted  tc  two  months)  as  of  the  end  of  the  LCG 
220  course.  The  first  such  area  dealt  with  the  terser. tarn 
cost  cf  visual  aids  made  for  the  LOG  220  course  that  were 


applicable  to  the  October  TEDS  effsrin 


lj.  expense: 


for  supplies  ar.d  labor  were  obtained  from  the  .Aril  Comp¬ 
troller.  Ehis  figure  was  then  divided  by  the  number  of 
LOG  220  classes  programmed  for  the  next  three-year  period 
(cased  on  IOC  percent  turnover  in  slides  every  three  years 
According  to  the  LOG  220  Course  Eirector,  LCG  220  will  be 
offered  apprcxim.ately  three  tim.es  a  tear  over  the  next 
three  years  (17).  Therefore,  the  following  formula  was 
developed: 


#  of  LCG  220 
classes  offered 
In  36  months 


Cost  to 
Produce 
Visual  Aids 


Cost 


The  second  area  requiring  computations  dealt  with 
one-time  investment  costs  paid  to  AT  &  T.  The  following 
formulae  resulted  in  identifying  a  prerated  investment 
cost  for  the  October  TEDS  offering.  Ail  cos^s  specified 
were  derived  from,  figures  supplied  by  AT  G  T  ar.d  the  Ge- 


fer.se  Electronics  Contracting  Office 


tt  o  o 


(6/11  x  Cost  of  Bridge) 


6/11  x 


60-7. 
c  n  9  — 
equi't 

i  <-»  i-?  ■■ 
^  O  O  „ 


r.ina- 


Total  Circuit 
Start-up  Cost 


Specific  AT  Sc  T  Equipment 
Purchases  fcr  one  /JFAFB 
rocm.  and  five  AFLC  rooms 


X, 


and 


» 


Get  TEDS  hours 

V 


x  (Xj 


PI 


where : 


X. 

v 

-  A 


Total  AFIT  and  AFLC  One- time  Charges 

Total  AFLC-related  Transmission  Time 
in  Hours 


PI  =  Prorated  Investment  fcr  Get  TioDS 


This  amount  specified  by  ?I  was  amortised  ever  a 
■.onth  period  to  reflect  anticipated  service  life  of  the 
rime  (or  start-up)  investment  costs  and  to  more 
:ably  apportion  this  cost  over  the  total  system. 

Y1  for  this  study  included  only  the  106  hours  trans- 
Lon  time  fcr  the  October  offering  cf  LOG  Z20. 

The  next  set  of  formulae  permitted  accurate  deter- 
rion  cf  that  portion  of  recurring  charges  for  AT  x  T 
;it,  equipment,  and  bridge  which  was  alic eatable  to 
Lotcber  TEES  class: 


1)  Recurring  Circuit  Charges: 

(a)  add  the  actual  monthly  charges  fcr 


iata  circuits  at  each  AFLC  classroom  fcr  all  arolioabl: 


( c)  next  determine  ,  the  total  actual  cir¬ 


cuit  hours  (transmission  hours)  used  by  AFLC  (NOTE:  this  is 
same  value  of  as  used  above.) 

(c)  xhen  compute  the  following: 


Oct  TEDS  hours 


Y 


(/)  x  X,  =  R, 


Circuit  Cost 
Allocatable  to 
Oct  TEDS 


(2)  Recurring  Bridge  Cost: 


Recurring 

Bridge 

Cost 


x  6/1 1  x 


TEDS  hours 

V,  V  / 


V 
-  1 


Bridge  Cost 
Allocatable  sc 
Cct  TEDS 


(3)  Recurring  Equipment  Cost 


o  : 


Recurring 

Equipment 

Cost 


Cct  TEDS  hours  , 

- v  l ;  ? ) 


“3 


Ailccatable  to 
Cct  TEDS 


(D)  Total  Recurring  Cost: 


R„  +  R0  *  R. 


Total  Recurring 
Cost  Allocatable 
to  Cct  TEDS 
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The  experimental  design  encompassed  herein  compare; 
d  a^~  a  j  d^ro p  2. ^  2.^ d.  Qv^d"C* ”,AC’ 
critique  data  across  the  various  treatments  or  teaching 


TABLE  2 

EXPERIMENTAL  DESIC-n  TABLE 


Teaching  Mode 

Demo¬ 

graphic 

Data 

. 

Score 

Data 

End-od-C  curse 
Critique 
Daxa 

NcnTSDS  to  TEDS 

X 

Resident  TEDS 

X 

X 

X 

to  Renote  TEDS 

Remote  TEDS'  to  Remote 

TEDS,  to  Remote  TEDS. 

, 

V 

^  3 

A 

X 

X 

to  Remote  TEDS  ,  to 

~r 

Remote  TEDS. 

m 

ABLE  3 

CONSOLIDATED  MATRIX 

TABLE 

Demo- 

Test 

E  r.  d  -  o  C  c  u  r  s  e 

graphic 

Score 

Grit  ic  ue 

Data 

Dax  a 

Data 

-  j£ 

Education  Level 

X 

Age 

.V 

Experience 

“ 

X 

Pre-test  Scores 

X 

i'csx-xest  Scores 

X 

Improvement  Index 

x 

Overall  Course  Content 

X 

TEDS  Related 

X 
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concerned  with  the  question  of  statistical  independence  of 


the  variables.  The  applicable  hypothesis  was  that  the 
variables  were  statistically  independent.  Rejection  of  th 
hy pothesis  ir.plied  that  the  variables  were  not  independent 
and  that  there  were  statistically  significant  differences 
between  the  classes  under  observation.  This  technique  was 
used  to  compare  demographic  and  end-of-course  data  between 
nor.TEDS,  resident  TEDS,  and  remote  TEDS  classes. 

Cne-way  Analysis  of  Variance  (AM07A) 

ANOVA  models  are  typically  used  to  analyze  the 
effects  of  the  independent  variable  under  study  upon  the 
dependent  variable  (14:42b).  yodel  I,  the  fixed  effects 
model,  v/as  applicable  here,  both  because  the  treatments 
were  chosen  due  to  a  special  interest  in  them  and  because 
they  were  not  a  sample  from  a  larger  population  (1^5^26). 
Furthermore,  no  attempt  was  made  to  generalize  the  test 
results  to  other  instructional  delivery  modes.  The  ANCYA 
technique  presented  a  mean  score  or  a  single  dependent,  cr 
criterion,  variable  for  each  class  under  observation.  A 
test  of  the  hypothesis  that  all  group  means  are  equal  was 
then  performed.  Rejection  of  this  hypothesis  implied  that 
at  least  two  of  the  groups  differed  significantly  in  cri¬ 
terion  near,  score.  This  method  was  used  to  analyze  the 
test  score  data  within  the  experimental  design. 


Multiple  Regression  Analysis 

Stepwise  multiple  regression  was  performed  pc 
evaluate  predictors  that  could  possibly  explain  any  signi¬ 
ficant  differences  in  mean  post-test  scores  and  improvement 
indices.  Predictor  variables  evaluated  were  demographic 
variables,  attitudes  toward  course  material,  instruction 
site  (VJPAF3  or  A1C )  ,  and  mode  of  presentation.  Regression 
models  were  constructed  by  entering  the  most  significant 
predictor  variables  sequentially  in  order  of  their  ability 
to  predict  the  criterion  variable  (12:5.  6).  Cnly  those 
predictor  variables  that  we re  statistically  significant 
at  the  five  percent  level  were  included  in  these  models. 

Descriptive  Statistics 

Descriptive  statistics  were  applied  to  the  data 
obtained  from  the  instructor  end-of-course  critiques. 

These  were  used  to  determine  frequencies  of  alternative 
responses . 


Likert  Scale 

A  Likert  scale  using  weighting  fact 
from  cero  for  positive  responses  to  four  fo 
responses  was  applied  fo  selected  questions 


crs  ranging 
r  negative 

'V'C’r  ■+■  V*>  0  £  r\ 


cf-course  student  and  instructor  critiques.  The  resulting 
variable  was  used  for  statistical  testing  and  class  com¬ 
parison.  To  ensure  compliance  with  Chi-square  analysis, 


i .  <■*■> 


requirements  regarding  minimum  expected  cell  size,  the 
"strongly  agree"  and  "agree"  responses  were  combined  to 
form  a  single  "agree"  variable.  The  "strongly  disagree" 
and  "disagree"  responses  were  combined  to  form  a  single 
"disagree"  variable. 

Criteria  Tests 

In  addition  to  the  statistical  tests  applied  to 
the  research  data,  decision  rules  were  also  necessary. 

These  decision  rules,  or  criteria  tests,  were  used  mo 
determine  if  the  results  of  the  data  analysis  were  of  im¬ 
portance  in  accomplishing  the  research  objectives. 

To  determine  if  the  objective  of  cost  effective¬ 
ness  was  met  with  the  implementation  of  TEDS  in  the  LOG  220, 
Materiel  Management  course,  a  decision  rule  was  established. 
If  the  average  cost  per  student  under  the  TEDS  method  of 
instruction  is  less  than  the  average  cost  per  student  under 
the  nonTEDS  method,  accept  the  hypothesis  that  the  TEDS 
method  used  in  the  LOG  220  course  is  less  costly  per  student 
than  the  in-residence  method. 

To  determine  if  the  objective  of  learning  ef¬ 
fectiveness  is  met  with  the  implementation  of  TEDS  in  the 
LCC-  220  course,  this  decision  rule  was  established:  If 
there  is  no  statistically  significant  difference  between 
the  post-test  scores  of  the  nonTEDS  class  and  the  TEDS 
class,  accept  the  null  hypothesis  that  learning  by  the 
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TEDS  method  is  as  effective  as  learning  by  the  in-residence 
method  in  the  LOG  220  course. 

To  determine  if  the  objective  of  acceptability  of 
the  TEDS  method  was  net  with  implementation  of  TEDS  in 
the  LOG  220  course,  these  decision  rules  were  established: 
If  the  mean  value  cf  the  questions  selected  to  determine 
acceptability  (questions  six  and  ten  from  the  instructor 
end-cf-course  critique;  questions  23  and  25  from  the 
students  end-cf-course  critique)  indicate  that  a  majority 
of  participants  find  the  system  acceptable,  accept  the  null 
hypothesis  that  the  TEDS  method  used  in  LOG  220  is  accept¬ 
able  to  participating  faculty  members  or  students,  as 
appropriate . 

Assumptions  and  Limitations 
Prior  to  commencement  of  a  research  study,  certain 
assumptions  had  tc  be  made  about  the  probability  distribu¬ 
tions  of  the  data  under  observation.  These  were  necessi¬ 
tated  by  the  inability  to  exactly  enumerate  the  population 
of  interest  in  this  study.  That  is,  as  discussed  in  the 
first  portion  of  this  chapter,  the  population  included  all 
personnel  eligible  for  participation  in  PCE  courses  who 
were  also  eligible  for  enrollment  in  the  LOG  22C  course, 
plus  all  AEIT  faculty  and  guest  instructors.  This  is  a 

impossible-tc-t ally  population . 


constantly  changing, 


Foremost  among  these  assumptions  (and  highly  desired  for 
use  of  statistical  methods  employed  for  analysis)  we re  the 
following: 

1 .  Probability  distributions  of  the  dependent 
variables  were  normal. 

2.  Each  of  the  probability  distributions  had 
the  same  variance. 

3.  The  observations  for  each  treatment  we re  random 
observations  from  the  corresponding  probability  distribution 
and  independent  of  observations  in  any  other  treatment. 


il  £ 
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CHAPTER  IV 


ANALYSIS  AND  INTERPRET AT I Cl 


Introduction 


This  chapter  serves  a  twofold  purpose. 


'so,  t r.s 


authors  analyzed  the  aggregate  of  information  produced  as 
a  result  of  the  methodology  developed  in  Chapter  III. 
Specifically,  analysis  was  performed  in  she  following  six 


areas : 


iccnomic 


2 .  Demograrhic 

3.  Test  Results 


A.  Student  Acceptability 

5.  Causal  Factor 

6.  Instructor  Acceptability 

Second,  the  results  obtained  in  each  of  the  above 
areas  were  interpreted  to  evaluate  the  numerous  economic 
comparisons  and  statistically  significant  variables.  In 
each  instance,  emphasis  was  placed  on  establishing  rele¬ 
vance  of  the  information  to  the  initial  hypotheses  pcsitec 
in  Chatter  I . 


Economic  Analysis 

The  specific  cost  items  defined  in  Charier  I! 
analyze  the  ~ctal  costs  for  each  of  the  two  r 


The  individual  TEDS  expenses  were  computed,  totaled,  then 
divided  ’ey  the  exact  number  of  students  that  participated 
in  the  October  TEDS  class.  The  same  process  was  completed 
Ter  the  July  ncnTEDS  class.  This  permitted  a  comparison  of 
per  student  costs  for  each  type  of  instruction. 


Instructor  haaes 

The  figure  derived  here  constituted  the  specific 
dollar  value  attributable  to  the  actual  time  AFIT  instruc¬ 
tors  spent  in  front  of  the  students,  i.e.,  platform  lectur¬ 
ing  time.  Discussion  in  Chapter  III  identifies  why  only 
AFIT  instructor  platform  time  was  used.  The  amount  cited 
was  the  same  for  both  TEDS  and  ncnTEDS  methods  because  the 
total  hours  taught  were  the  same  (ICS  hours):  TEDS  re¬ 
quired  2?  days  at  four  hours  per  day;  ncnTEDS  required 
15  days  at  six  hours  per  day.  The  cost  for  classroom 
instruction  (minus  AF1C  guest  speakers)  is  shown  in  Table  - 

The  October  TEDS  class  incurred  an  additional  cost 
due  to  sending  15  instructors  to  the  five  remote  sites  to 
conduct  a  major  managerial  exercise.  Although  these  in¬ 
structors  were  directly  involved  ir.  the  TEDS  exercise  for 
only  four  hours  a  day  for  five  days,  the  researchers  com¬ 
puted  this  cost  using  b-0  hours  per  person .  This  was  becauss 
the  instructors  were  dedicated  totally  to  the  LOG  220  pro¬ 
gram  for  eight  hours  a  day  and  used  the  non-exercise 
times  to  give  extra  instruction  and  evaluate  students' 


results.  The  figure  cited  in  Table  5  was  a  valid  cost  for 


inclusion  in  the  TEDS  method.  However,  this  cost  will  not 
be  repeated  because  local  (on-site)  personnel  will  be 
trained  to  conduct  the  exercise  for  all  subsequent  classes 
Because  it  was  impossible  and  irrelevant  at  this  juncture 
to  estimate  cost  of  such  local  assistance,  the  expense  was 
outside  the  purview  of  this  research.  However,  future 
studies  in  this  area  must  pay  full  consideration  to  this 
cost.  The  specific  computations  used  to  derive  the  variou 
hourly  wages  shown  in  Table  5  are  located  in  Appendix  G . 

Cost  of  Visual  Aids 

The  relevant  cost  here  was  the  cost,  in  terms  of 
supplies  and  labor,  to  produce  six  sets  of  visual  aids 
for  the  LOG  220  course.  The  six  were  comprised  of  one 
master  set  and  five  complete  sets  of  copies.  The  followin 
information  identifies  the  specific  expenses: 

Item  Cost 

Supplies  $3033.82 

Labor  9130.00 

$12, 163  -82 

Expected  number  of  LOG  220  classes  offered  in 
three -year  period:  9 

Therefore : 


(1/9) 


($12,163.82)  =  $1351 .1: 


do 

■  / 


TABLE 


The  specific  costs  for  supplies  and  labor  v/ere 
derived  from  raw  data  supplied  by  the  AF1T  Comptroller. 


Remote  Classroom  Monitor  Wages 

The  cost  of  providing  one  monitor  per  remote  class¬ 
room  during  the  2?  four-hour  periods  is  reflected  in 
Table  6.  The  specific  computations  used  to  derive  the 
hourly  wages  are  located  in  Appendix  C- . 

AT  &  T  Equipment  Installation/ 

Investment  Costs 

The  combined  cost  paid  to  AT  &  T  to  install  the 
circuits,  bridge,  and  equipment  is  computed  in  Table  ?. 
Equipment  furnished  by  AT  &  T  consisted  of  the  electronic 
blackboard,  transceiver,  memory  unit,  blackboard  stand, 
cabinet,  5GA,  amplifier,  business  line,  and  503  key. 

Therefore,  applying  the  figure  from  Table  7  ~o 
the  specified  formulas 

(6/11  x  $12,941)  +  (6/11  x  $1972.56) 

+  $3520.50  =  $11,655.44 


($11,653.44  6  60)  x  2  =  S3S8.61 

And,  Y,  =  transmission  hours  for  LOG  220  =  10c 

H  Vip  V*0  £ q  V'O  ; 


S3  2  c 
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TABLE 


TABLE  7 


INSTALLATION /INVESTMENT  COSTS 

Item 

C  ost 

Bridge 

$12,9^1.00 

C ircuits 

1,973-56 

Equipment 

VJPAFB 

$556.75 

OOALC 

536.75 

OCALC 

536.75 

SMALC 

536.75 

SAALC 

536 . 75 

>JRALC 

536 . 75 

S3. 520 . 50 

TOTAL 

$15,440.06 

Recurring  AT  &  T  Costs 

To  compute  system-wide  recurring  charges,  informa¬ 
tion  was  gleaned  from  AFIT  Comptroller  and  Defense  Elec¬ 
tronics  Contracting  Office  reports.  For  this  study,  the 
relevant  rate  period  included  October  ar.d  November 
(from  time  TEDS  circuits  were  activated  to  end  of  November). 


Recurring  Circuit  Charge 


2.  Recurring  Bridge  Charge 
Total  rate:  $780 

$780  x  6/11  x  =  $425.45 

3.  Recurring  Equipment  Charge 
Total  rate:  $7056.08 

x  $7056.08  =  $7056.08 

4.  Total  Recurring  Costs 

$15,093-44  +  $425.45  +  $7056.08  =  $22,574.97 
Classroom  Equipment 

Specific  classroom  equipment  purchased  for  the  six 
classrooms  consisted  of  microphone  equipment  and  stereo 
tape  recorders.  Additionally,  AFIT  purchased  two  tele¬ 
vision  monitors  for  its  classroom.  As  stated  in  Chapter 
III,  cost  of  all  technical  equipment  (Appendix  E)  required 
to  present  the  TEDS  LOG  220  was  considered  in  an  attempt  to 
determine  total  costs  to  initiate  this  methodology.  Total 
costs  are  displayed  in  Table  3. 

Contract  Management 

This  cost  was  identified  from  reports  supplied  to 
the  AFIT  Comptroller  by  the  Defense  Electronics  Contracting 
Office  (DECC  )  .  It  amounted  to  $7000. 

Total  TEDS  Costs  for  October 
Offering  of  LOG  220 

Table  9  constitutes  a  summary  of  costs  for  TEDS 
instructional  method  used  in  the  October  TEDS  class. 
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TA3LE  3 


CLASSROOM  EQUIPMENT 


Item 

Cost 

Sxereo  Tape  Recorders 

$  1,212.00 

Projection  Equipment 

2,966.00 

Television  Monitors 

1,  SCO .  00 

Microphone  Equipment 

U: ,260. CO 

TOTAL  $1^.215.00 

AMORTIZED  COST  OVER  60  MONTHS: 

($13,218.00  +  60)  x  2  =  $LA0.60 


TABLE  9 

TOTAL  TEDS  COSTS  FOR  OCTOBER  TEDS  LOG  220 


Item  Cost 


Instructor  Wages 

$19,1-95 . 56 

Visual  Aids 

1,361.15 

Monitor  Wages 

5,6 35-41- 

Prorated  Investment 

388.61 

Recurring  Expenses 

22,576.97 

Classroom  Equipment 

LEO . 60 

Contract  Management 

7,000.00 

TOTAL 

-$86,579 .71 
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This  figure  was  then  divided  by  the  number  of 
students  to  determine  the  per  student  cost  (minus  AFLC 
guest  speakers)  to  conduct  the  October  LOG  220  TEDS  class: 

$56,879  01  -f  144  =  $395.00 

It  must  be  reemphasized  that  this  figure  included 
the  instructor  costs  of  conducting  the  LOG -MAN -X  exercise 
at  the  remote  sites.  Since  this  function  will  be  accom¬ 
plished  by  qualified  local  (on-base)  personnel  in  the  fu¬ 
ture,  AFIT  and  AFLC  will  incur  no  additional  direct  costs. 
Therefore,  the  overall  cost  area  of  instructor  wages  will 
decrease  dramatically.  It  is  interesting  tc  note  that  the 
per  student  cost  for  a  TEDS  LOG  220  class  minus  these  TDY 
costs  would  be  $285 > 13 

Computing  the  nonTEDS  per  student  costs  was  less 
demanding  than  the  above  process  because  fewer  cosx  items 
were  involved. 

Instructor  Wages 

As  noted  in  the  analysis  of  TEDS  Instructor  Wages, 
the  basic  cost  attributable  to  instructor  platform  time  wa 
the  same  for  both  types  of  instruction  because  total  class 
room  hours  were  identical.  Total  TEDS  Instructor  Wages, 
as  depicted  in  Table  4,  were  $3,675.34.  This  amount,  how¬ 
ever,  included  $1464.62  as  the  costs  attributed  to  the 
course  director  and  his  assistant  in  preparing  TEDS 


materials  for  shipment  to  the  remote  sites.  Since  this 
action  was  not  required  for  the  nonTEDS  course,  it  was 
deducted  from  the  $3678.34.  Consequently,  the  AFIT  non¬ 
TEDS  cost  for  Instructor  Wages  was  $2213.72.  As  mentioned 
earlier,  this  expense  related  strictly  to  the  cost  of 
platform  time  for  AFIT  instructors.  Because  the  class  was 
conducted  in  July  and  This  research  effort  did  not  begin 
until  October,  it  was  deemed  infeasible  to  consider  making 
even  a  crude  guess  at  the  costs  related  to  unknown  AFLC 
guest  lecturers  and  their  incidental  expenses,  e.g., 
automobile  expenses,  productive  time  lost  from  their  every¬ 
day  jobs,  cost  of  administrative  assistance  in  preparing 
lecture  materials,  at  their  various  offices,  and  prepara¬ 
tion  time  for  their  lectures.  Rather,  the  researchers 
simply  acknowledged  the  lack  of  accurate  information  in 
this  area  and  computed  per  student  costs  without  it. 

Visual  Aids 

No  cost  data  were  available  on  the  expense  for 
visual  aids  (overhead  slides)  for  the  July  nonTEDS  class. 
This  was  due  in  large  part  to  the  fact  that  AFIT  did  not 
maintain  most  of  these  slides.  Instead,  each  guest  lec¬ 
turer's  home  office  maintained  its  own  slides  for  the 
lecturer's  use.  AFIT  kept  only  those  slides  used  by  its 
own  instructors.  However,  in  keeping  with  the  idea  that 
the  AFLC/AFIT  costs  must  be  identified  if  possible,  the 


researchers  asked  for  the  LOG  220  course  director's  esti¬ 
mate  of  how  many  slides  totally  were  used  in  the  July 
ncnTEDS  class.  His  response  of  approximately  2000  was 
multiplied  by  $4,  the  approximate  cost  incurred  by  base 
graphics  to  locally  produce  a  typical  slide .  The  octal 
cost  computed  was  $8000.  As  with  the  TEDS  visual  aids 
( 35mm  slides),  the  expected  turnover  rate  for  these  over¬ 
head  slides  was  100  percent  every  three  years.  Since  the 
ncnTEDS  LOG  220  course  had  been  offered  an  average  of 
five  times  per  year,  this  equated  to  15  total  offerings  of 
the  course  during  the  last  relevant  time  period.  Conse¬ 
quently,  by  dividing  the  total  cost  of  one  set  of  over¬ 
head  slides  ($8000)  by  15,  the  cost  of  visual  aids  fcr  the 
July  ncnTEDS  offering  was  $533*33* 

Student  Per  Diem 

A  total  of  25  students  attended  the  July  ncnTEDS 
class.  Seven  of  these  were  from  Wright-Fatterson  and  con¬ 
sequently  did  not  receive  per  diem  for  their  time  spent  in 
this  course.  However,  the  other  18  students  traveled  to 
this  central  location  from  the  five  Air  Logistics  Centers. 
Consequently,  the  per  diem  cost  was  computed  as: 


18  x  $26  x  18  days 


$8424 


The  $26  figure  was  a  standard  Temporary  Duty  (TDY ) 
amount  supplied  by  the  AFIT  Comptroller. 

Student  Travel  Pay 

Using  the  airline  fares  that  were  valid  for  the 
July  1979  period,  the  amounts  specified  in  Table  10  con¬ 
stituted  the  major  portion  of  travel-related  expenses. 

TABLE  10 

STUDENT  TRAVEL  COSTS 


#  of  Cost  Per 

Site  Students  Fare  Site 


CCALC 

2  x 

$214  = 

$423 

00  ALC 

2  x 

$316 

$632 

SAALC 

6  x 

$252 

$1512 

SM  AuC 

6  x 

$444 

$2664 

'/JR  ALC 

2  x 

S142 

$284 

TOTAL 

$5520. 

An  additional  $25  per  student  was  added 

to  conform 

with  st 

;andard  Accounting  and 

Finance  procedures 

.  This 

amount 

represented  a  variety 

of  incidental  cost 

s  such  as 

taxi  fare  to  and  from  airports. 

$2p  x  IS  students  =  $450 


cq 


Therefore,  "total  student  travel  pay  consisted  of 


the  sum  of  these  two  expenses,  i.e.j 
$5520  r  $450  =  $5970 

Classroom  Equipment 

This  category  related  solely  to  equipment  items 
used  in  the  nonTEDS  instruction  of  the  LOG  220  course. 
Specific  costs  are  displayed  in  Table  11.  This  amount: 
was  divided  by  6  0  to  determine  the  amortized  cost  over 
a  60  -  month  period,  i.e.s 


($1604.68  7  6C)  x  2  =  $53.49 

TABLE  11 

CLASSROOM  EQUIPMENT  COSTS 


Item 

C  ost 

Overhead  Project or 

$350.00 

TV  Recorder/Playback 

$1254,68 

TOTAL 

$1604 . 66 

Total  nonTEDS  Costs  for  July 
Offering  of  LOG  220 

Table  12  constitutes  a  summary  of  costs  attributabl 
to  the  nonTEDS  instructional  method  used  in  the  July  ncn- 


TEDS  class. 

TABLE  12 

TOTAL  COSTS  FOR  JULY  KOI’ 

{TEDS  LOG  220 

Item 

Cost 

Instructor  Wages 

$2213.72 

Visual  Aids 

■3533  >33 

TDY  Per  Diem 

$£L2b.C0 

Travel  Pay 

$5970.00 

Classroom  Equipment 

$53.29 

TOTAL 

$17, 192.52 

This  figure  was  then  divided  by  the  number  of 
participating  students  to  determine  the  total  per  student 
cost  to  conduct  the  July  nonTEDS  class  of  LOG  220: 

$17,194.5L  c  22  =  3716.  bb 


Finally,  by  comparing  the  two  per  student  totals, 
a  measure  of  relative  cost  effectiveness  was  established. 


Specifically; 

nonTEDS;  $?16.44 
TEDS ;  $39  5. CO 

$321.44 

That  is,  it  cost  $321.44  less  to  teach  a  student 
via  the  October  TEDS  class  of  LOC-  220  than  it  did  to 
teach  a  student  via  the  July  nonTEDS  class. 

Analysis  of  Demographic  Data 
In  accordance  with  the  experimental  design  speci¬ 
fied  in  Chapter  III,  the  frequency  distributions  cf  the 
four  demographic  variables  (rank,  education  level,  age, 
logistics  experience)  were  compared  via  crosstabulation. 
These  results  were  then  evaluated  for  homogeneity  using  a 
Chi-square  Contingency  Table  analysis  in  conjunction  with 
the  hypothesis  that  the  variables  were  statistically  in¬ 
dependent.  To  comply  with  the  Chi-square  analysis  concept 
of  minimum  expected  cell  size,  categories  within  each  cf 
xhe  demographic  variables  were  combined  as  necessary.  The 
researchers  used  the  standard  five  percent  as  a  relevant 
level  of  significance.  Any  Contingency  Table  analysis 

significantly  are  identified  and 


results  that  differed 


oltHl 


discussed  below 


.  Those  results  that  did  not  significantly 
differ  are  displayed  in  Appendices  H  through  C.  To  pro¬ 
vide  the  reader  an  opportunity  for  individual  evaluation, 
the  minimum  significance  levels  which  would  have  had  to 
have  been  achieved  for  each  demographic  variable  to  reject 
the  hypothesis  are  stipulated. 

Comparison  between  TEDS  and  nonTEDS 
Demographic  Variables 

The  ncnTSDS  students  were  slightly  better  educated 
than  their  TEDS  counterparts  (Appendix  H) ,  and  the  TEDS 
students  were  slightly  older  (Appendix  I)  >  However,  cvera 
there  were  no  significant  differences  between  the  ncn.EDS 
control  group  and  the  TEDS  experimental  group.  Tc  actuall 
have  rejected  the  hypothesis  identified  above,  the  mini¬ 
mum.  significance  levels  for  each  demographic  variable 
would  have  had  to  have  been  set  as  shown  in  Table  1 3 • 


om.parison  Between  Resident 
EDS  and  Remote  TEDS 

Within  the  overall  TEDS  contingent,  significant 
differences  were  noted  in  both  the  rank  (Table  14)  and 
education  (Table  15)  distributions.  The  rank  distribution 
indicated  that  the  resident  TEDS  group  had  a  greater 
preponderance  of  higher -ranking  students  than  did  the 
remote  TEDS  group.  Also,  the  resident  students  appeared 
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TABLE  13 


MINIMUM  SIGNIFICANCE  LEVELS  FOR 
DEMOGRAPHIC  VARIABLES 


Variable 

P-Val' 

Grade  or  Rank 

.1952 

( A  veer,  d  ix  L) 

Education  Level 

»  k 

O 

Vn 

O 

Age 

.5072 

Logisxics  Experience 

.3019 

(Appendix  V) 

TABLE  ID 

CRCSST A3ULAT I ON  OF  RANK  DISTRIBUTION 
BY  TEDS  GROUPS 


R  a  r.k 


Remote 

TEDS  Total 


,  02 , 

5-GS1C 

3  .  ?fS 

,  GS11 

-r  » 

,  GS12 

66.7 

21 

,  GS13 

d  up 

20.3 

Significance 

level: 

p  <C  .0001 

23 . 9f5 
39  .6 
23.9 


7.7 


»-l . 


The  rerr.ore  group  appeared  rc  he  slightly  tide 
har.  the  resident  group  (Appendix  J)  ;  however,  'here 
tatisticaliy  signidioanr  didderences  ter  veer.  the  grc 
irh  respect  ro  either  age  or  experience,  y.inir.ur.  si 
ic since  level  dor  ase  was  .0913  2nd  dor  exrerier.ee  wa 
9‘~5i  (Appendix  K)  . 

cr.rariscn  .Across  Renote  Sites 

Both  the  distribution  dor  rank  (Table  lo)  and 
isrricution  dor  experience  (Table  It)  showed  signidi 
idderer.oes  when  ccnrared  across  all  revere  TEDS  loca 
The  rank  distribution  indicated  a  higher  rank 
r  Sac  rar.er.ro  ALC  while  the  bulk  cd  lower-ranking  ir.d 
uals  v/ere  located  at  Cgden,  San  Antonio,  and  'darner- 


By  contrast,  however,  the  experience  distribution 


indicated  the  least  experienced  participants  were  at 
Sacramento  and  the  most  experienced  students  were  located 
at  Ogden. 

Although  not  statistically  significant,  the  Warner- 
Robins  participants  were  slightly  younger  (A.ppendix  N) 
and  less-educated  (Appendix  0)  than  the  rest  of  the  remote 
TEDS  students.  The  minimum  significance  level  for  education 
was  .5127  and  for  age  was  .5961. 

Test  Results 

This  portion  of  analysis  considered  three  variables: 
pre-test  scores,  post-test  scores,  and  the  difference 
between  the  two,  which  is  referred  to  as  the  "improvement 
index."  Mean  scores  were  computed  for  each  of  these  vari¬ 
ables  within  each  group.  One-way  analysis  of  variance 
(AM OVA)  was  used  to  test  for  significant  differences  in 
the  following  areas: 

1.  Between  the  nonTEDS  and  TEDS  groups 

2.  Between  the  resident  TEDS  and  remote  TEDS 

3.  Among  the  five  remote  TEDS  locations 

Mean  scores  are  presented  in  Table  IS  and  significance 
levels  are  displayed  in  Table  19. 

The  comparison  of  TEDS  and  nonTEDS  groups  indicated 
a  highly  significant  difference  in  both  pre-test  scores 
and  improvement  indices;  however,  no  significant  difference 
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was  discovered  in  post-test  results  at  the  five  percent 
level.  The  low  mean  pre-test  score  obtained  by  the  nonTEDS 
group  was  the  major  factor  leading  to  these  differences. 

TABLE  18 

MEAN  TEST  SCORES  AND  IMPROVEMENT  INDICES 


Pre-test 

Post-test* 

Improvement 

All  Students 

60.4  % 

8  2.3% 

20.5% 

NonTEDS 

51.2 

84.0 

32.2 

TEDS 

61.9 

82.0 

13.6 

Resident 

64.5 

83.2 

18.6 

Remote 

61.4 

31.7 

18.6 

Ogden 

56.9 

85.3 

25.0 

Oklahoma  City 

60.0 

82.1 

22.0 

Sacramento 

64.0 

80.4 

15.6 

San  Antonio 

58.6 

81.5 

18.5 

Warner  Robins 

67 . 3 

79.4 

11.9 

*Mean  Improvement  may  differ  slightly  from  Mean  Post- test  minus 
Mean  Pre-test  score  because  of  missing  scores. 

Analysis  of  the  five  remote  locations  indicated 
no  significant  difference  in  test  scores  across  the  sites 
at  the  five  percent  level.  There  was,  however,  a  signifi¬ 
cant  difference  in  improvement  which  can  be  attributed  to 
results  at  Warner-Robins  and  Ogden.  Warner-Robins  had  the 
highest  pre-test  score  but  the  lowest  post-test  score,  hence 


the  smallest  improvement  index.  Ogden,  on  the  other  hand, 
had  the  lowest  pre-test  score  and  the  highest  post-test 
score,  hence  the  largest  improvement  index. 


i 


The  analysis  of  these  variaoles  comparing  the 
resident  TEDS  and  remote  TEDS  groups  indicated  no  signifi¬ 
cant  difference  at  the  five  percent  level.  Although  the 
mean  scores  for  the  remote  group  were  slightly  lower  than 
those  for  the  resident  group,  the  improvement  indices  were 
particially  identical. 

TABLE  19 

SIGNIFICANCE  LEVELS  FOR  TESTS  OF  DIFFERENCES  1 


Pre-test 

Post-tes t 

Improvement 

Between  nonTEDS  and 

TEDS 

.0013 

.2293 

.0002 

Between  Resident  TEDS 
and  Remote  TEDS 

.  3653 

.  3964 

.9958 

Among  Remote  TEDS 

Sites 

.1043 

.0856 

.0397 

The  tremendous  disparity  of  pre-test  scores  between 
the  ncnTEDS  and  overall  TEDS  groups  tended  to  distort  the 
improvement  indices.  As  a  result,  further  analysis  was 
conducted  comparing  the  nonTEDS  group  with  the  TEDS  group 
(Ogden)  that  had  a  pre-test  result  closest  to  that  of  the 
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nonTEDS  group  (56.9).  Significance  levels  for  this  com¬ 
parison  are  displayed  in  Table  20. 


TABLE  20 

SIGNIFICANCE  LEVELS  FOR  TESTS  OF  DIFFERENCES  2 


Pre-test  Post-test  improvement 

Between  nonTEDS  and 

Ogden  TEDS  .1679  .5656  .1146 

The  comparison  of  the  nonTEDS  and  the  Ogden  remote  TEDS 
groups  indicated  no  significant  differences  in  pre-test, 
post-test  results,  or  improvement  indices. 

Analysis  of  Student  Acceptability 
In  accordance  with  the  experimental  design  speci¬ 
fied  in  Chapter  III,  the  frequency  distributions  of  the 
responses  to  end-of-course  critique  questions  were  com¬ 
pared  using  the  crosstabulation  statistical  technique. 

These  results  were  then  compared  for  significant  differences 
between  groups  using  Chi-square  Contingency  Table  analysis 
in  conjunction  with  the  hypothesis  that  the  variables 
were  statistically  independent.  The  standard  five  percent 
was  again  used  to  determine  relative  significance.  Each 
critique  question  with  applicable  response  percentages  is 
presented.  The  minimum  significance  levels  necessary  to  de¬ 
termine  statistical  independence  have  been  provided  for 
each  level  of  comparison. 

7 1 


Responses  to  the  following  question  are  displayed 


in  Table  21:  "The  course  objectives  were  made  clear  either 
orally  or  in  the  instructions." 

TABLE  21 

COURSE  OBJECTIVES  CLEAR 


Type  Presentation 

Strongly 

Agree/ 

Agree 

Neither 

Strongly 

Disagree/ 

Disagree 

NonTEDS 

91.7% 

4 .2% 

4.2% 

TEDS 

87 . 5 

5 . 5 

6.9 

(Significance : 

p  =  .0534) 

Resident  TEDS 

96.0 

0 

4.0 

Remote  TEDS 

85.8 

6 . 7 

7 . 5 

(Significance : 

p  =  .2292) 

Ogden 

91.7 

4.2 

4.2 

Oklahoma  City 

81.8 

9.1 

9.1 

Sacramento 

100 

0 

0 

San  Antonio 

76 . 9 

3.8 

19.2 

Warner- Rob ins 

79 . 1 

16 . 7 

4.2 

(Significance  : 

p  =  .1394) 

Analysis 

indicated  no 

significant 

difference 

in  the 

perception  of  clear  course  objectives  between  the  TEDS  and 
nonTEDS  students.  Most  TEDS  students  appeared  to  be 


in  agreement  that  the  objectives  were  made  clear. 


Responses  to  the  following  question  are  displayed 
in  Table  22:  "The  course  appeared  well  structured." 

TABLE  22 

COURSE  WELL  STRUCTURED 


Strongly  Strongly 

Agree/  Disagree/ 

Type  Presentation  Agree  Neither  Disagree 


NonTEDS 

100 . 0% 

0% 

0% 

TEDS 

79 . 3 

11.7 

9.0 

(Significance : 

p  =  . 0740 ) 

Resident  TEDS 

96 

4.0 

0 

Remote  TEDS 

75.8 

13.3 

10.8 

(Significance : 

p  =  .1163) 

Ogden 

91.7 

8 . 3 

0 

Oklahoma  City 

63.2 

18.2 

13.6 

Sacramento 

87 . 5 

0 

12 . 5 

San  Antonio 

57.7 

23.1 

19 . 2 

Warner-Robins 

75.0 

16.7 

8  .  3 

(Significance : 

p  =  .  1984  ) 

Analysis  indicated  r.o  significant  difference  between 

the  nonTEDS  and 

TEDS  students  conce 

rning  the  structure 

of 

the  course.  Bo 

th  nonTEDS  and  TEDS 

students  agreed  tha 

t  the 

course  appeared 

well  structured. 

Responses  to  the  following  question  are  displayed 


in  Table  23:  "The  course  structure  permitted  questions  to 
be  asked  and  answered  satisfactorily." 

TABLE  23 

QUESTIONS  ASKED  AND  ANSWERED  SATISFACTORILY 


Type  Presentation 

Strongly 

Agree/ 

Agree 

Neither 

Strongly 

Disagree/ 

Disagree 

NonTEDS 

95.8% 

0% 

4 .2% 

TEDS 

74.5 

11.0 

14 . 4 

(Significance : 

P  ~ 

.0141) 

Resident  TEDS 

100 

0 

0 

Remote  TEDS 

69.1 

13.3 

17.5 

(Significance : 

p  = 

.0002) 

Ogden 

70.8 

20 . 8 

8.3 

Oklahoma  City 

81.8 

18.2 

0 

Sacramento 

70.8 

12.5 

16.7 

San  Antonio 

84.6 

0 

15.4 

Warner- Rob ins 

37.5 

16.7 

45.8 

(Significance : 

P  = 

.0134) 

Analysis 

indicated  significant 

differences 

at  all 

levels  of  comparison  concerning  the  interchange  between 
student  and  instructor.  The  majority  of  the  nonTEDS 


students,  resident  TEDS  students,  and  all  remote  TEDS 


students,  except  Warner-Robins ,  were  satisfied  with  the 
opportunity  for  student-instructor  interchange. 

Responses  to  the  following  question  are  displayed 
in  Table  24:  "The  room  was  conducive  to  learning." 

TABLE  24 

ROOM  CONDUCIVE  TO  LEARNING 


Type  Presentation 

Strongly 

Agree/ 

Agree 

Neither 

Strongly 

Disagree/ 

Disagree 

NonTEDS 

87 . 5% 

8  .  3% 

4 . 2 

TEDS 

60.0 

11.0 

29.0 

(Significance : 

P  = 

.0057) 

Resident  TEDS 

74.0 

8.0 

8.0 

Remote  TEDS 

55.0 

11.7 

33.4 

(Significance : 

P  = 

.0367) 

Ogden 

95.8 

4.2 

0 

Oklahoma  City 

36 . 3 

13.2 

4  5.5 

Sacramento 

79 . 2 

20 . 8 

0 

San  Antonio 

53.9 

15.4 

30 . 7 

Warner-Robins 

8 . 3 

0 

91.7 

(Significance: 

P  = 

.0000) 

Analysis  indicated  a  significant  difference 
among  the  remote  sites  as  to  perceptions  of  adequacy  of 


their  academic  environment.  More  Oklahoma  City  and  Warner- 
Robins  studencs  found  fault  with  their  surroundings  than 
did  students  at  the  remaining  remote  locations.  It  is  inter¬ 
esting  to  note  that  the  resident  TEDS  students  expressed 
slightly  less  acceptance  of  the  classroom  than  did  the  r.onTEDS 
group  although  both  used  the  same  classroom. 

Responses  to  the  following  question  are  displayed  in 
Table  25:  "There  should  have  been  more  handout  materials." 

TABLE  25 

MORE  HANDOUT  MATERIALS 

Strongly  Strongly 

Agree/  Disagree/ 

Type  Presentation  Agree  Neither  Disagree 


NonTEDS 

37.5% 

20.8% 

41.6% 

TEDS 

22.1 

17.9 

60.0 

(Significance : 

P  = 

.2506) 

Resident  TEDS 

20.0 

8.0 

72.0 

Remote  TEDS 

22.5 

20 . 0 

57.5 

(Significance : 

P  = 

.0955) 

Ogden 

8.4 

16.7 

75.0 

Oklahoma  City 

31.8 

22.7 

45.5 

Sacramento 

20 . 8 

12.5 

6  6.7 

San  Antonio 

26.9 

23.1 

50 . 0 

Warner- Robins 

25.0 

25.0 

50 . 0 

(Significance : 

P  = 

.7858) 

Analysis  indicated  no  significant  differences  for 
all  comparison  levels  concerning  the  desire  for  more  hand¬ 
out  materials.  With  the  exception  of  Oklahoma  City,  all 
TEDS  sites  felt  there  were  adequate  handout  materials. 

The  NcnTEDS  group  tended  more  strongly  toward  additional 
handout  materials  than  any  TEDS  site,  resident  or  remote. 

Responses  to  the  following  question  are  displayed 
in  Table  26:  "I  will  be  able  to  do  my  job  better  as  a 
result  of  this  course." 

TABLE  26 

ABLE  TO  DO  JOB  BETTER 


Type  Presentation 

Strongly 

Agree/ 

Agree 

Neither 

Strongly 

Disagree/ 

Disagree 

NonTEDS 

95.9% 

4.2% 

0% 

TEDS 

72.4 

20.0 

7 . 6 

(Significance:  p  =  .0178) 

ResidentvTEDS 

80.0 

16.0 

4.0 

Remote  TEDS 

70.9 

20.8 

8.4 

(Significance:  p  =  .7646) 

Ogden 

83.3 

12.5 

4 . 2 

Oklahoma  City 

59.1 

27.3 

13.6 

Sacramento 

87.5 

8.3 

4.2 

San  Antonio 

61.6 

19.2 

19 . 2 

Warner- Robins 

62.5 

37.5 

0 

(Significance:  p  =  .2674^ 


Analysis  indicated  significant  difference  between 


NonTEDS  and  TEDS.  The  NonTEDS  group  felt  the  course  would 
contribute  significantly  more  to  their  job  performance  than 
did  the  TEDS  group.  There  was  no  significant  difference 
noted  between  the  resident  TEDS  and  remote  TEDS  groups, 
nor  among  remote  TEDS  sites.  Students  in  all  groups  expressed 
a  positive  attitude  toward  the  course's  contribution  to  their 
future  job  performance. 

Responses  to  the  following  question  are  displayed  in 
Table  27:  "I  liked  the  hours  the  course  was  offered." 

TABLE  27 
LIKED  THE  HOURS 


Type  Presentation 

Strongly 

Agree/ 

Agree 

Neither 

Strongly 

Disagree/ 

Disagree 

Resident  TEDS 

24% 

4.0% 

72.0% 

Remote  TEDS 

47.0 

14.3 

46.2 

(Significance:  p  =  .0397) 

Ogden 

54.2 

25.0 

20.8 

Oklahoma  City 

45.4 

18.2 

36.4 

Sacramento 

8.4 

4.2 

37 . 4 

San  Antonio 

46.2 

11.5 

42.3 

Warner- Robins 

43.4 

13.0 

4  3.5 

(Significance:  p  =  .0094) 


Analysis  indicated  significant  differences  between 


resident  and  remote  TEDS  groups  and  also  among  remote 
groups  concerning  the  desirability  of  the  classroom 
schedule.  Classroom  schedules  differed  for  the  groups 
depending  upon  the  time  zone  in  which  the  site  'was  located. 
Classes  ranged  from  noon  to  four  o'clock  in  the  afternoon 
for  Eastern  time  zone  students  and  from  nine  o'clock  in  the 
morning  to  one  o'clock  in  the  afternoon  for  Pacific  time 
zone  students.  Neither  the  resident  TEDS  students  nor  the 
remote  TEDS  students  as  a  group  were  pleased  with  the 
classroom  hours.  Only  Ogden  students  liked  the  hours. 

Responses  to  the  following  question  are  displayed 
in  Table  28:  "The  teleteach  delivery  system  is  an  accept¬ 
able  learning  medium." 

TABLE  23 

TELETEACH  ACCEPTABLE 


Type  Presentation 

Strongly 

Agree/ 

Agree 

Neither 

S  trong ly 

Disagree, 

Disagree 

Resident  TEDS 

6  8.0% 

20.0% 

12.0% 

Remote  TEDS 

65.8 

8.3 

25.8 

(Significance:  p  = 

.2256) 

Ogden 

75.0 

8.3 

16 . 7 

Oklahoma  City 

4  5.5 

9.1 

4  5.5 

Sacramento 

33.3 

3  .  3 

S  .  4 

San  Antonio 

76.9 

7 . 7 

15.4 

Warner -Rob ins 

45.8 

S  .  4 

45.  S 

(Significance:  p  = 

.1330) 

Analysis  indicated  no  significant  difference  between 


the  resident  students  and  the  remote  students  as  a  group 
concerning  the  acceptability  of  TEDS  as  a  learning  medium. 
Also  there  was  no  significant  difference  among  the  remote 
sites.  The  Oklahoma  City  and  Warner-Robins  students  were 
equally  divided  in  response  to  this  question  and  neither 
provided  a  majority  in  the  contrasting  categories. 

Responses  to  the  following  question  are  displayed 
in  Table  29:  "I  would  take  another  course  which  used  this 
delivery  system." 

TABLE  29 

WOULD  TAKE  ANOTHER  COURSE 


Type  Presentation 

Strongly 

Agree/ 

Agree 

Neither 

Strongly 

Disagree/ 

Disagree 

Resident  TEDS 

68.0% 

4.0% 

28.0% 

Remote  TEDS 

65.8 

13.3 

20.8 

(Significance:  p  = 

.2124} 

Ogden 

70.8 

20 . 8 

3 . 4 

Oklahoma  City 

50.0 

13.6 

36 . 4 

Sacramento 

83.3 

8.3 

8 . 4 

San  Antonio 

69 . 2 

15.4 

15.4 

Warner-Robins 

54.1 

8.3 

37 . 5 

(Significance:  p  = 

.  2756 ) 
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Analysis  indicated  that  most  students  were  in 
agreement  that  they  would  take  another  course  presented 
by  TEDS . 

Responses  to  the  following  question  are  displayed 
in  Table  30:  "There  should  be  more  interaction  among  the 
sites .  " 

TABLE  30 

MORE  INTERACTION 


Type  Presentation 

Strongly 

Agree/ 

Agree 

Neither 

Strongly 

Disagree/ 

Disagree 

Resident  TEDS 

56.0% 

3  2.0% 

12 . 0% 

Remote  TEDS 

64.2 

29 . 2 

6.6 

(Significance:  p  =  .6109) 

Ogden 

50.0 

45.3 

4.2 

Oklahoma  City 

45.4 

4  5.5 

9  .  1 

Sacramento 

83.3 

12.5 

4.2 

San  Antonio 

6  5.4 

26.5 

7 . 7 

Warner- Robins 

75.0 

16 . 7 

8 .  3 

(Significance:  p  =  .2749) 


Analysis  indicated  no  significant  differences 
between  or  among  groups  concerning  the  level  of  interaction 
among  the  sites.  .'lose  students  indicated  the  level  of 
interaction  should  be  increased. 
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Responses  to  the  following  question  are  displayed 
in  Table  31:  "The  absence  of  eye  contact  with  the  instructor 
created  a  learning  barrier  problem." 

TABLE  31 

EYE  CONTACT  PROBLEM 


Type  Presentation 

Strongly 

Agree/ 

Agree 

Neither 

Strongly 

Disagree/ 

Disagree 

Remote  TEDS 

82.5% 

6.7% 

10.8% 

Ogden 

70.9 

8.3 

20.8 

Oklahoma  City 

90.9 

4.5 

4.5 

Sacramento 

87.5 

0 

12.5 

San  Antonio 

73.1 

19.2 

7.7 

Warner-Robins 

91.7 

0 

8.3 

(Significance:  p  =  .0367) 

Analysis  indicated  most  remote  students  considered 
the  lack  of  eye  contact  with  the  instructor  an  impairment 
to  their  learning  the  material  presented.  A  significant 
difference  was  revealed,  however,  in  the  comparison  of  responses 
among  the  remote  sites. 

Responses  to  the  following  question  are  displayed 
in  Table  32:  "The  site  monitor  appeared  knowledgeable  of 
equipment  operation." 
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TABLE  32 


IP 


SITE  MONITOR  KNOWLEDGEABLE 


Type  Presentation 

Strongly 

Agree/ 

Agree 

Neither 

Strongly 

Disagree/ 

Disagree 

Remote  TEDS 

92.5% 

2.5% 

5.0% 

Ogden 

100.0 

0 

0 

Oklahoma  City 

100.0 

0 

0 

Sacramento 

95.8 

4.2 

0 

San  Antonio 

76.9 

7.7 

15.4 

Warner- Robins 

91.7 

0 

8.3 

(Significance:  p  =  .1085) 


Analysis  indicated  no  significant  differences  among 
the  remote  sites  concerning  the  students'  perceptions  of  the 
site  monitors'  equipment  knowledge. 

Responses  to  the  following  question  are  displayed 
in  Table  33:  "The  site  monitor  had  the  room  and  materials 
prepared  for  class." 
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TABLE  33 


SITE  MONITOR  PREPARED  CLASSROOM 


Type  Presentation 

Strongly 

Agree/ 

Agree 

Neither 

Strongly 

Disagree/ 

Disagree 

Remote  TEDS 

84.2% 

5.0% 

10.8% 

Ogden 

100.0 

0 

0 

Oklahoma  City 

100.0 

0 

0 

Sacramento 

95.8 

0 

4.2 

San  Antonio 

38.5 

19.2 

42.3 

Warner- Rob ins 

91.7 

4.2 

4.2 

(Significance:  p  = 

.0000) 

Analysis  indicated 

that  only  San 

Antonio 

students 

felt  the  site  monitor 

had  not  adequately 

prepared 

the  classroom 

This  accounted  for  the  significant  difference  in  responses 
among  the  remote  sites. 
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Responses  to  the  following  question  are  displayed 
in  Table  34:  "A  different  classroom  should  be  used." 

TABLE  34 

DIFFERENT  CLASSROOM  NEEDED 


Type  Presentation 

Strongly 

Agree/ 

Agree 

Neither 

Strong ly 

Disagree/ 

Disagree 

Remote  TEDS 

44.2% 

22.5% 

3  3.3% 

Ogden 

8.3 

25.0 

66.7 

Oklahoma  City 

63.6 

27 . 3 

9.1 

Sacramento 

20.8 

37.5 

41.7 

San  Antonio 

30.8 

23.1 

46.2 

Warner-Robins 

100.0 

0 

0 

(Significance:  p  =  .0000) 


Analysis  indicated  a  significant  difference  among 
the  remote  sites  concerning  the  need  for  a  different 
academic  environment.  Warner-Robins  students  were  in  total 
agreement,  and  a  majority  of  the  Oklahoma  City  students 
indicated  that  a  different  classroom  should  be  used.  All 
other  sites  indicated  that  their  classroom  was  adequate. 

As  established  in  Chapter  III,  the  overall  accept¬ 
ability  of  TEDS  was  determined  by  the  combination  of  responses 
to  the  questions  concerning  TEDS  acceptability  (Table  28)  and 
desire  to  take  another  TEDS  course  (Table  29) .  The  results 
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of  this  merger  are  displayed  in  Table  35. 


TABLE  35 

OVERALL  TELETEACH  ACCEPTABILITY 

Type  Presentation  Acceptable  Neutral  Unacceptable 


Resident  TEDS 

68.0% 

20.0% 

12.0% 

Remote  TEDS 

68.3 

14.2 

17.5 

(Significance:  p  =  .6562) 

Ogden 

79.2 

16.7 

4.2 

Oklahoma  City 

45.5 

27.3 

27.3 

Sacramento 

87.5 

4.2 

8.3 

San  Antonio 

80.8 

3.8 

15.4 

Warner-Robins 

45.8 

20.8 

33.3 

(Significance:  p  =  .0066) 


Analysis  indicated  no  significant  difference  between 
the  overall  remote  responses  and  the  resident  responses. 

The  majority  of  the  TEDS  students  found  the  mode  acceptable. 

A  significant  difference  did  exist,  however,  among  the  remote 
sites  with  a  considerable  percentage  of  students  at  both 
Oklahoma  City  and  Warner-Robins  indicating  that  TEDS  was  not 
acceptable  . 


Casual  Factor  Analysis 

Stepwise  multiple  regression  models  were  constructed 
to  compare  and  evaluate  the  relative  importance  of  the 
demographic  variables,  mode  acceptability,  and  type  or 
location  of  instruction  in  influencing  student  learning. 
Models  were  constructed  to  explain  only  those  significant 
differences  encountered  in  the  ANOVA  tests  for  post-test 
scores  and  improvement  indices.  The  following  variables 
were  used  as  predictors  and  were  included  in  the  model  if 
the  corresponding  coefficients  differed  significantly  from 
zero  at  the  five  percent  level. 

1.  Student  rank 

2.  Student  educational  achievement  level 

3.  Student  age 

4.  Student  logistics  experience 

5.  Type  (TEDS  or  nonTEDS)  or  location  of  instruc¬ 
tion  (coded  using  dummy  variables) 

6.  TEDS  acceptability,  determined  by  combining  the 
students'  responses  to  the  following  critique  question: 
"Teleteach  is  an  acceptable  learning  medium.";  and  "I 
would  take  another  course  which  used  this  delivery  system." 

The  predictor  model  constructed  to  explain  the 
significant  difference  in  the  improvement  index  for  TEDS 
and  nonTEDS  is  displayed  in  Table  36. 
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TABLE  36 


PREDICTOR  MODEL,  TEDS/NONTEDS 


Criterion  Variable: 

Improvement 

Index 

Significant 

Predictor 

Variable 

Unnormalized 

Coefficient 

Beta 

Weight 

Significance 

Level 

Dummy  var 

TEDS 

-12.35 

-.26 

p<.05 

Education 

level 

3.01 

.17 

p<..  05 

(Constant  term) 

23.68 

Coefficient  of  determination, 


.11 


Analysis  indicated  the  most  significant  predictor 
variable  to  be  associated  with  mode  of  learning.  A  member 
of  the  TEDS  group  was  predicted  to  achieve  a  significantly 
lesser  amount  of  improvement  than  a  member  of  the  nonTEDS 
group.  Although  education  level  was  found  to  be  a  signifi¬ 
cant  predictor,  previous  demographic  analysis  indicated  no 
significant  differences  between  the  TEDS  and  nonTEDS  groups 
with  respect  to  educational  achievement  level.  As  a  result 
the  effects  of  this  predictor  variable  were  inconsequential 
The  predictor  model  constructed  to  explain  the 
significant  difference  in  the  improvement  index  for  the 
remote  TEDS  sites  is  displayed  in  Table  37. 


TABLE  37 


PREDICTOR  MODEL,  REMOTE  TEDS 


Crite 

ricn  Variable: 

Improvement 

index 

Significant 

Predictor 

Variable 

Unnormalized 

Coefficient 

Beta 

Weight 

Significance 

Level 

Dummy  var, 

Ogden 

10.88 

.28 

.0001 

Dummy  var, 
Oklahoma  City 

7-79 

.19 

.0045 

Education 

level 

2.6? 

.16 

.0191 

(Constant  term) 

12.01 

Coefficient  of  det 

ermination,  R 

2  _ 

-  .  0c 

Analysis  indicated  the  most  significant  predictor 
variables  to  he  associated  with  location  at  a  particular 
sixe.  Being  a  participant  at  either  Ogden  or  Oklahoma 
City  predicted  a  significantly  greater  improvement  than 
being  at  the  base  site,  Wamer-Robins .  Although  education 
level  was  found  to  be  a  significant  predictor,  previous 
demographic  analysis  indicated  no  significant  differences 
among  the  remote  sites  in  regard  to  academic  achievement 
level.  As  a  result,  the  effects  of  this  predictor  variable 
v/ere  inconsequential. 
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Analysis  of  Instructor  Acceptability 
Frequency  distributions  were  accomplished  for  the 
collected  responses  to  the  TEDS  instructor  end-of-course 
critiques.  Distribution  results  from  the  36  participating 
instructors  are  presented  with  the  percentage  of  responses 
to  each  alternative. 

Question  1:  "Before  using  the  teleteach  system,  I 
felt  it  wouldn't  be  effective." 

A.  Strongly  agree  -  0 

B .  Agree  -  5.6 

C.  Neither  agree  nor  disagree  -  33.3 

D.  Disagree  -  44.4 

E.  Strongly  disagree  -  16.7 

The  responses  indicated  no  preconceived  notion  of  ineffec¬ 
tiveness  attributed  to  this  mode  of  presentation. 

Question  2:  "The  teleteach  system  provides  advan¬ 
tages  not  normally  available." 

A.  Strongly  agree  -  22.2 

B.  Agree  -  63.9 

C.  Neither  agree  nor  disagree.  -  13.9 

D.  Disagree  -  0 

E.  Strongly  disagree  -  0 

The  responses  indicated  that  instructors  felt  TEDS  offered 
advantages  over  other  presentation  methods  they  had  previous¬ 
ly  used. 
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Question  3: 


Students  at  WPAFB  participated 


adequately . " 

A.  Strongly  agree  -  25 

B.  Agree  -  61.1 

C.  Neither  agree  nor  disagree  -  5.6 

D.  Disagree  -  5.6 

E.  Strongly  disagree  -  2.8 

The  responses  indicated  that  resident  TEDS  students  par¬ 
ticipated  to  the  extent  expected  by  the  instructor. 

Question  4:  "Students  at  remote  sites  participated 
adequately . " 

A.  Strongly  agree  -  5.6 

B.  Agree  -  41.7 

C.  Neither  agree  nor  disagree  -  25.0 

D.  Disagree  -  25 

E.  Strongly  disagree  -  2.8 

The  responses  indicated  that  instructors  thought  that 
remote  TEDS  students  might  have  participated  more,  yet 
their  participation  was  certainly  adequate. 

Question  5:  "Students  appeared  to  have  learned  the 
material  I  presented." 

A.  Strongly  agree  -  11.1 

B.  Agree  -  41.7 

C.  Neither  agree  nor  disagree  -  41.7 
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D.  Disagree  -  5.6 

E.  Strongly  disagree  -  0 

The  responses  indicated  that  over  half  of  the  instructors 
felt  learning  had  occurred  while  a  considerable  percentage 
41.7,  were  not  willing  to  speculate. 

Question  6:  "I  would  like  to  use  the  teleteach 
system  again." 


A. 

Strongly 

agree 

30.6 

3  . 

Agree 

47.2 

C. 

Neither  , 

agree  nor 

disagree 

D. 

Disagree 

-  5.6 

E. 

Strongly 

disagree 

-  0 

The  responses  indicated  that  a  large  majority  of  instruc¬ 
tors  would  like  to  use  the  TEDS  instructional  method  again 
Question  7:  "I  felt  uncomfortable  when  I  used  the 
teleteach  system." 


A. 

Strongly 

agree 

8.3 

B. 

Agree 

33.3 

C. 

Neither 

agree  nor 

disagree 

D. 

Disagree 

-  38.9 

E. 

Strongly 

disagree 

-  13.9 

The  responses  indicated  that  most  instructors  felt  com¬ 
fortable  using  the  system  while  an  important  percentage, 
41.6,  did  indeed  feel  uncomfortable. 

Question  3;  "Students  don't  seem  to  learn  well 


with  the  teleteach  system. 


A. 

Strongly 

agree 

0 

B. 

Agree 

2.8 

C. 

Neither  . 

agree  nor 

disagree 

D. 

Disagree 

-  38.9 

E . 

Strongly 

disagree 

-  11.1 

The  responses  indicated  that  most  instructors  felt  this 
system  did  not  negatively  impact  student  learning. 
Responses  to  this  question  confirm  the  results  of  question 
5  . 

Question  9:  "My  inability  to  see  the  students  at 
the  remote  site  was  disconcerting." 

A.  Strongly  agree  -  8.3 

B.  Aqree  -  27.8 

C.  Neither  agree  nor  disagree  -  13.9 

D.  Disagree  -  41.7 

E.  Strongly  disagree  -  8.3 

The  responses  indicated  that  most  instructors  did  not 
feel  a  lack  of  face-to-face  contact  impaired  their  pre¬ 
sentations  . 

Question  10:  "After  using  the  teleteach  system 
I  feel  mere  favorable  toward  its  use." 


A. 

Strongly 

agree 

16.7 

B. 

Agree 

38.9 

C. 

Neither 

agree  nor 

disagree 

D. 

Disagree 

-  11.1 

9  3 


30.6 


E.  Strongly  disagree  -  2.8 

The  responses  indicated  that  TEDS  gained  favor  as  a  result 
of  use  by  participating  instructors. 

Questions  11-15  were  not  included  in  our  analysis  since  they 
pertain  only  to  course  related  aspects  and  do  not  contribute 
to  the  acceptability  factor  under  consideration. 

Questions  six  and  ten  directly  addressed  the  issue  of  tele- 
teach  acceptability .  Therefore,  the  results  were  combined 
to  determine  overall  instructor  acceptability  of  TEDS. 
Results  indicated  that  75  percent  of  the  instructors  found 
TEDS  acceptable,  5.6  percent  found  it  unacceptable,  and  19.4 
percent  remained  uncommitted. 

Assimilation  of  the  preceding  analysis  areas  led  to  the 
inferences,  conclusions,  and  recommendations  presented  in 
the  next  chapter. 
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CHAPTER  V 


CONCLUSIONS  AND  RECOMMENDATIONS 


Introduction 

In  this  chapter  the  findings  discussed  in  Chapter 
III  were  evaluated  in  light  of  the  initial  hypotheses 
specified  at  the  end  of  Chapter  I.  Each  of  these  hypothe¬ 
ses  is  restated  and  considered  below.  Because  this  re¬ 
search  effort  analyzed  only  the  data  from  a  single  TEDS 
offering  of  the  LOG  220  course,  it  would  have  been  inappro¬ 
priate  to  generalize  these  findings  across  either  the  LOG 
220  program  in  general  or  the  TEDS  instructional  mode  in 
tcto.  Therefore,  it  is  stressed  at  this  juncture  that 
the  conclusions  drawn  from  the  analysis  in  Chapter  IV  relate 
solely  to  the  July  and  October  1979  offerings  of  LOG  220. 


Conclusions 

Cost  Evaluation 

The  first  hypothesis  dealt  with  economic  comparisons. 
It  stated?  "The  TEDS  approach  used  in  the  LOG  220  course 
is  less  costly  than  the  in-residence  method  of  instruction 
for  the  course."  Due  to  the  different  types  of  expenses 
incurred  in  each  of  the  methods,  there  was  no  opportunity 
to  do  a  point-by-point  comparison  of  TEDS  costs  and  ncnTEDS 
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costs.  Further,  in  discussing  costs  of  educational  pro¬ 
grams  such  as  these,  it  is  typical  to  consider  per  student 
costs  as  a  prime  indicator  of  overall  program  viability. 
Therefore,  information  was  gathered  and  analyzed  to  deter¬ 
mine  total  per  student  costs  of  each  instructional  method. 

In  an  after-the-fact  evaluation  such  as  this  study, 
it  was  extremely  difficult  (and  in  some  cases  infeasible) 
to  identify,  separate,  and  weigh  all  relevant  costs.  Con¬ 
sequently,  certain  heuristics  had  to  be  applied  to  allow 
cost  specification  and  comparison.  The  authors  readily 
admit  that  a  much  more  comprehensive  future  economic  evalua¬ 
tion  could  be  done  if  all  applicable  costs  were  tracked  as 
they  occurred.  As  discussed  in  Chapter  17,  in  those  areas 
where  nothing  but  a  gross  guess  could  have  been  made  (such 
as  v/ith  AFLC  instructor-related  costs)  ,  the  choice  was 
consciously  and  conscientiously  made  to  acknowledge  the 
lack  of  information  and  pursue  a  legitimate  result  without 
that  specific  bit  of  information.  This  process  resulted  in 
a  definitive  per  student  cost  for  the  July  nonTEDS  class 
and  for  the  October  TEDS  class.  It  is  recognized  that  fu¬ 
ture  comparisons  of  this  type  may  result  in  different  con¬ 
clusions.  However,  the  conclusion  reached  in  this  study 
that  the  TEDS  method  of  instruction  costs  less  on  a  per 
student  basis  than  does  the  nonTEDS  method  is  firm  and 
valid  based  on  the  information  obtained.  Therefore,  the 
above-stated  hypothesis  is  supported. 


Learning  Effectiveness 

The  second  hypothesis  was  concerned  with  relative 
learning  effectiveness.  It  stated:  "Learning  via  the  TEDS 
approach  is  as  effective  as  learning  by  the  in-residence 
method  of  instruction  in  the  LOG  220  course."  As  used  in 
this  statement,  the  term  "in-residence"  was  synonymous 
with  the  term  "nonTEDS" .  Based  on  the  scores  obtained  from 
tests  administered  throughout  the  course,  there  was  in 
fact  no  significant  difference  in  learning  effectiveness 
bet ween  the  TEDS  and  nonTEDS  approaches.  Therefore  this 
hypothesis  is  also  supported. 

The  significant  difference  in  improvement  index  be¬ 
tween  the  two  groups  was  attributed  to  the  large  disparity 
in  pre-test  scores.  To  compensate  for  this  disparity, 
additional  analysis  compared  the  nonTEDS  class  with  the 
TEDS  class  displaying  the  lowest  pre-test  average.  Analysis 
established  that  no  significant  differences  were  present. 
Additionally,  there  were  no  significant  differences  in 
performance  results  between  the  resident  TEDS  students  who 
had  the  advantage  of  face-to-face  contact  with  the  instruc¬ 
tor  and  the  remote  TEDS  students,  whose  contact  with  the 
instructor  was  limited  to  audio  and  blackboard  video. 

Among  the  remote  locations,  the  slight  difference  in  im¬ 
provement  was  again  attributable  primarily  to  differences 
in  pre-test  scores.  This  was  evidenced  by  the  regression 
analysis . 
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Although  regression  analysis  also  delineated  educa¬ 


tional  achievement  level  as  a  significant  contributor  to 
an  individual's  degree  of  improvement,  demographic  analysis 
indicated  group  homogeneity  in  this  area.  Therefore,  educa¬ 
tion  level  did  not  appear  to  be  the  reason  for  any  improve¬ 
ment  differences. 

Based  on  these  findings,  it  was  concluded  that  the 
Teleteach  Expanded  Delivery  System  was  as  effective  as  the 
traditional  nonTEDS  approach  in  achieving  learning. 

Instructor  Acceptability 

The  third  and  fourth  hypotheses  both  dealt  with 
acceptability  of  the  TEDS  instructional  method.  The  third 
hypothesis  focused  on  acceptability  of  TEDS  by  the  instruc¬ 
tors.  It  stated:  "The  TEDS  method  of  delivery  used  in  LOG 
220  is  acceptable  to  participating  faculty  members."  The 
analysis  of  instructor  end-of -course  critiques  indicated  that 
75  percent  of  the  participating  instructors  found  the  tele¬ 
teach  system  acceptable.  In  addition,  55.6%  of  the  instruc¬ 
tors  indicated  they  had  become  more  favorable  towards  TEDS 
after  using  the  system. 

Based  on  these  findings ,  it  was  concluded  that  the 
teleteach  system  was  acceptable  to  the  instructors.  There¬ 
fore,  the  hypothesis  was  supported. 

Student  Acceptability 

The  final  hypothesis  looked  at  acceptability  of  the 
TEDS  method  by  the  students.  It  stated:  "Students  enrolled 
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in  LOG  220  consider  the  TEDS  an  acceptable  instructional 
delivery  system. "  Based  on  the  responses  to  end-of-course 
questions,  the  students  using  TEDS  generally  felt  it  was 
an  acceptable  way  to  learn.  The  TEDS  students  thought  the 
organization  of  the  LOG  220  course  as  a  whole  was  acceptable. 
Further,  the  nonTEDS  class  appeared  to  be  satisfied  with  the 
general  conceptual  framework  of  LOG  220  and  the  TEDS  classes 
also  appeared  satisfied.  It  followed  that  any  dissatisfac¬ 
tion  with  the  mode  did  not  create  a  hostile  attitude  toward 
the  course  in  general. 

Time  zone  differences  appeared  to  be  more  of  a  concern 
for  those  students  in  the  Central  and  Mountain  time  zones 
than  for  those  in  the  Eastern  and  Pacific  time  zones.  Per¬ 
haps  the  requirement  to  report  to  work  as  normal  and  accomplish 
daily  job-related  tasks  both  before  and  after  classes  created 
an  unsuitable  climate  at  three  of  the  sites.  However,  the 
factor  did  not  seem  to  exist  at  Sacramento  or  Wright-Patterson. 
An  inconsistency  appeared  between  the  two  Eastern  time  zone 
locations,  viz.,  Wright-Patterson  students  favored  the  hours 
of  instruction,  but  Warner-Robins  students  did  not  approve 
of  the  hours.  Further  information  would  be  necessary  to 
ascertain  the  reason  for  this  difference  as  their  work  and 
classroom  schedules  should  have  been  the  same.  The  demographic 
difference  of  age,  education,  and  rank  may  have  given  them 
different  perspectives  on  their  schedules  and  work  load 
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requirements . 

The  classroom  environment  appeared  to  create  con¬ 
siderable  discontent.  For  Oklahoma  City  and  Warner-Robins , 
students  felt  another  room  should  be  used.  The  students  at 
Warner-Robins  did  not  like  the  classroon  environment,  and 
thought  a  change  of  rooms  was  necessary.  In  the  case  of 
Ogden  students,  however,  a  desire  for  another  classroom  did 
not  appear  to  impair  their  learning  since  they  achieved  the 
greatest  degree  of  improvement  from  beginning  to  end  of  the 
class.  At  Warner-Robins ,  on  the  other  hand,  the  classroom 
environment  may  have  been  primarily  responsible  for  the 
students'  lesser  degree  of  improvement. 

One  of  the  more  interesting  elements  that  was  con¬ 
sidered  in  this  study  was  the  effect  on  learning  of  eye 
contact  (or  lack  thereof)  between  instructor  and  student. 

Most  of  the  students  and  some  of  the  instructors  perceived 
the  lack  of  eye  contact  to  be  a  problem.  This  is  not,  how¬ 
ever,  supported  by  the  test  results.  Comparisons  were  made 
between  the  various  classes  to  narrow  and  explain,  if 
possible,  this  impact.  Resident  students  with  the  advan¬ 
tage  of  eye  contact  did  not  fare  any  better  on  the  tests 
than  did  the  remote  students.  The  comparison  of  the  Ogden 
remote  class  to  the  nonTEDS  class  which  had  the  advantage 
of  eye  contact  showed  no  apparent  differences.  Although 
lack  of  eye  contact  was  perceived  by  the  program's  partici¬ 
pants  as  a  problem,  it  did  not  appear  to  actually  impair  learnin 
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Based  on  these  findings  it  was  concluded  that  the 
TEDS  method  of  learning  is  acceptable  to  participating 
students.  Therefore,  the  hypothesis  was  supported. 

Recommendations 

Throughout  this  study,  it  has  been  stressed  that 
no  attempt  should  be  made  to  generalize  the  findings  herein 
over  the  wider  range  of  the  entire  TEDS  program.  Rather, 
this  paper  constituted  an  initial  evaluation  of  a  new  mode 
of  instruction  methodology  developed  by  AFIT.  The  analysis 
conducted  and  the  conclusions  reached  were  limited  to  two 
specific  LOG  220  classes.  However,  even  though  the  actual 
scope  of  this  study  was  confined,  certain  recommendations 
can  be  made  which  will  hopefully  improve  the  overall  TEDS 
program.  These  recommendations  fall  into  two  areas — those 
that  are  made  to  directly  improve  the  current  system,  and 
those  that  suggest  related  areas  of  study  to  pursue. 

Research  completed  for  this  study  resulted  in  dis¬ 
covery  of  several  areas  where  the  current  TEDS  system  could 
be  improved.  San  Antonio  students  indicated  the  site 
monitor  should  make  a  concentrated  effort  to  prepare  the 
classroom. 

With  respect  to  the  second  point  (classroom  require¬ 
ments)  ,  AFIT  and  AFLC  headquarters  must  stress  to  the  ALCs 
the  absolute  necessity  of  identifying  a  classroom  for  TEDS 
use  which  is  environmentally  and  physiologically  desirable. 
Poor  classroom  conditions  can  result  in  negative  feelings 


about  the  class  offering  in  particular  and  the  entire  TEDS 
system  in  general. 


Students  should  be  given  an  initial  briefing  on  the 
positive  and  negative  aspects  of  TEDS.  This  "up  front" 
approach  to  explaining  TEDS  will  hopefully  dispell  false 
assumptions  isuch  as  the  effect  upon  learning  when  there  is 
no  eye  contact)  ana  allow  the  stuaents  to  concentrate  on 
the  message  of  the  course  rather  tnan  its  medium. 

Possibly  the  course  director  should  explain  to  the 
instructors  ana  students  rhe  potential  of  TEDS  to  reach 
more  students,  to  teach  effectively,  and  to  save  the  Air 
Force  a  great  deal  of  time  and  money. 

The  student  ena-of-course  critique  should  be  revised 
so  as  to  draw  out  students'  specific  feelings  about  TEDS  and 
reasons  for  liking  or  disliking  it.  The  present  critique  does 
not  adequately  do  this. 

Turning  to  those  recommendations  regarding  further 
study  in  this  area,  it  became  obvious  as  this  research  drew 
to  a  close  that  much  follow-on  research  could  be  accomplished. 
Since  this  study  evaluated  strictly  the  first  TEDS  offering, 
a  logical  step  would  be  similar  evaluation  of  a  subsequent 
LOG  220  class  or  of  other  TEDS  courses.  Such  research  could 
examine  each  of  the  areas  evaluated  in  this  study  (cost, 
learning  effectiveness,  attitude),  or  it  could  focus  in  much 
greater  detail  on  one  specific  parameter.  Or,  research  could 
be  done  on  the  overall  TEDS  for  some  period  of  time,  e.g., 
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one  fiscal  year.  This  would  entail  a  systemic  evaluation 
approach  which  included  all  TEDS  courses  offered  in  that 
year.  Again,  research  could  concentrate  on  one,  all,  or  some 
combination  of  the  three  primary  areas  of  evaluation.  By 
way  of  suggestion,  if  the  attitudinal  area  is  to  be  assessed 
thoroughly,  the  researchers  should  prepare  and  use  specific 
attitudional  questionnaires  for  students,  instructors,  and 
site  monitors.  This  would  preclude  the  use  of  the  somewhat 
limited  existing  end-of-course  critique.  Such  research  as 
is  suggested  in  this  paragraph  should  accomplish  two  things; 
it  should  validate  the  findings  of  this  study;  and  it  should 
help  round  out  the  overall  evaluation  of  TEDS,  thereby  help¬ 
ing  it  become  a  powerful  and  positive  mode  of  instruction. 

It  is  obvious  that  many  questions  regarding  LOG  220 
and  TEDS  remain  unanswered.  But  then,  it  was  not  the  purpose 
of  this  study  to  identify  or  analyze  all  aspects  of  the  new 
system.  Rather,  the  intent  was  to  determine  if,  with  respect 
to  this  initial  class,  TEDS  could  provide  at  least  the  same 
level  of  learning  at  less  cost  and  still  be  accepted  by  its 
users.  Based  on  the  analysis  herein,  TEDS  succeeded  in  all 
three  areas . 
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APPENDIX  A 

DEMOGRAPHIC  INFORMATION 


DEMOGRAPHIC  I NF  C RMAT I ON 


GENERAL  INSTRUCTIONS  FOR  COMPLETING  THE  SURVEY 


Use  the  attached  answer  sheet  to  mark  your  responses .  Use  only  a  No .  2 
pencil  when  filling  cut  the  answer  sheet.  CO  NOT  USE  INK.  Enter  your 
4-digit  student  number  in  the  last  four  positions  in  the  STUDENT  NUMBER 
area.  Please  do  NOT  -write  your  name  or  social  security  number  anywhere 
on  the  answer  sheet.  Select  only  one  answer  to  each  question.  Mark  the 
answer  sheet  carefully  to  negate  computer  error.  Fill  in  the  box  with 
a  heavy  mark;  do  not  go  outside  the  lines  of  the  box.  If  you  make  a 
mistake,  erase  the  mark  completely  before  entering  a  new  one. 


1.  My  present  military  rank  is; 

A.  06 
3.  05 

C.  04 

D.  03 

S.  02  or  01 

2.  My  present  civilian  grade  is: 

A.  GS-14  or  higher 

B.  GS-13 

C.  G5-12 

D.  GS-11 

E.  GS-5  thru  GS-I0 

3.  My  educational  background:  (mark  highest  completed) 
(You  will  answer  question  3  or  4,  not  both.) 

A.  Did  not  complete  high  school 

B.  High  school  graduate  or  equivalent 

C.  College— seme  credits 

D.  College  -  Associate  degree  (A. A.  or  A. Sc". ) 

E.  College  -  Baccalaureate  degree  (3. A.  or  3.S.) 

4.  Educational  background:  (continued  from  above) 

A.  College  -  Graduate  credit,  no  graduate  degree 

B.  College  -  Master's  Degree 

C.  College  -  Work  beyond  Master's 

D.  College  -  Doctorate 

E.  None  of  the  above 


You  will  only  answer  three  of  the  next  six  questions,  5  or  6,  7  or  3, 
9  or  10. 

The  first  digit  of  your  DAFSC  or  Civilian  Occupation  Code: 

5.  A.  0  3.  1  C.  2  D.  3  E.  4 

6.  A.  5  3.  6  C.  7  0.  3  E.  9 

The  second  digit  of  your  DAFSC  or  Civilian  Occupation  Code : 

7.  A.  0  3.  1  C.  2  D.  3  S.  4 

8.  A.  5  B.  6  C.  7  D.  8  S.  9 

The  third  digit  of  your  DAFSC  or  Civilian  Occupation  Code: 

9.  A.  0  3.  1  C.  2  D.  3  E.  4 

10.  A.  5  3.  6  C.  7  D.  8  E.  9 

11.  My  present  age  is: 

A.  20-25 

B.  26-35 

C.  36-45 

D.  46-55 

E.  56-cr  over 

12.  Years  of  experience  in  a  job  related  to  the  course: 

A.  0-1 
3.  2-3 

C.  4-5 

D.  6-7 

S.  3  or  more 
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APPENDIX  B 

STUDENT  END-OF-COURSE  CRITIQUE 
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This  critique  is  designed  to  obtain  feedback  concerning  whether  the  course 
achieved  its  objocti'es.  Your  daily  critiques  have  addressed  most  of  the 
specific  aspects  of  the  course.  Your  contribution  tc  the  improvement  of 
this  course  is  greatly  appreciated  and  will  benefit  future  students. 

Please  answer  each  question  to  the  best  of  your  ability.  Your  answer  sheet 
will  be  machir-'  processed  except  for  the  last  six  questions.  Additional 
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Mark  the  answer  sheet  carefully  to  negate  computer  error.  Fill  in  the  box 
with  a  heavy  mark;  do  net  go  outside  the  lines  of  the  box.  If  you  make  a 
mistake,  erase  the  nark  ccmnletelv  before  entering  a  new  one.  The  last 
six  questions  in  the  critique  require  a  written  response.  Put  your  answers 
on  the  back  of  the  answer  sheet. 


Respond  by  using  the  options  A  thru  E  indicating  the  degree  to  which  you 
a  tree  with  the  statements  below. 


C 


0  . 


tzronz.j.y  agree 
Agree 

.‘.’either  agree  nor  disagree 
Disagree 

Strcn^lv  disagree 


(These  options  will  be  repeated  at  the  top  of  each  page  for  your  convenience 

The  course  objective:;  were  mace  clear  either  orally  or  in  the  instruc¬ 
tional  1  .  u  d  . 


course  appeared  well  structured. 

ermitted  cuestions  tc  be  asked  and  answered 


5.  The  course  r.tructur 
satisfactor: .7 . 


The  room  was,  conducive  to  learning. 

I  was  in  a  oor-itien  where  I  could  hear  and  see  well. 
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A  .  :  tr^r.g'.  y  agree 

B .  Agree 

C.  Neither  agree  i;or  disagree 

D.  Disagree 

E.  Strongly  disagree 

6.  There  should  nave  been  more  handout  materials. 

7.  The  course  should  have  been  longer. 

8.  My  time  could  have  been  better  utilized  elsewhere. 

9.  I  will  be  able  to  do  my  job  better  as  a  result  of  this  course. 

10.  The  course  met  rnv  expectations. 

11.  The  course  was  more  informative  than  I  had  anticipated. 

12.  Overall,  the  course  was  extremely  difficult. 

13.  Throughout  the  course,  there  was  adequate  transition  between  the 
various  days  of  instruction  in  terms  of  tying  in  and  relating  materials. 

14.  The  simulation  exercise  aided  in  the  total  learning  experience. 
(Darken  "c"  if  net  applicable.) 

15.  Discussion  c:  the  tests  helped  me  learn. 

15.  The  tests  were  giver,  at  proper  intervals. 

17.  I  liked  the  hours  the  course  was  offered. 

13.  I  learn  more  from  a  course  when  I  am  TDY  (completely  removed  from  my 
job  location). 

13.  When  required  to  critique  presentations,  I  learn  less  of  the  content 
presented. 

20.  The  ''class  day"  should  be: 

A.  -l“2  ..ours 

3.  2-3  hours 

C.  3-4  hours 

D .  4-5  hours 

E.  5-6  hours 

21.  How  many  classes  were  you  unable  to  attend? 

A.  1-5  S.  4-8  C.  7-iO  D.  11-15  E.  Mere  than  15 


no 


22.  How  m  a;,  v  classes  did  you  "nuke  up"  through  playback  oi  the  aucivtapes? 

A.  1-3  B.  4-6  C.  7-10  D.  11-15  £ .  "ore  than  15 

Use  these  responses: 

A.  Strongly  agree 

B.  Agree 

C.  Neither  agree  nor  disagree 
D-.  Disagree 

E.  Strongly  disagree 

35.  The  teieteach  delivery  system  is  an  acceptable  learning  medium. 

24.  The  teleconferencing  equipment  (mikes  and  blackboard)  was'  easy  to 
operate . 

25.  I  would  take  another  course  which  used  this  delivery  system. 

26.  Tnere  should  be  more  interaction  among  the  sites. 

NOTE:  is  PATH  personnel  do  not  answer  questions  27-30. 

27.  The  absence  of  eye  contact  with  the  instructor  created  a  learning 
barrier /problem. 

23.  The  person  locally  aiding  the  course  director  (site  monitor)  appeared 
knowledgeable  of  equipment  operation. 

29.  The  local  person  aiding  the  course  director  (site  monitor)  had  the 
room  and  materials  prepared  for  class. 

30.  A  different  classroom  should  be  used. 

PART  IX 

Answer  these  slx  questions  on  the  back  cf  your  answer  sheet. 

(The  six  questions  referenced  were  not  analyzed  in  this  study.) 
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INSTRUCTOR  CRITIQUE  OF  TELETEACH 
DELIVERY  SYSTEM 
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INSTRUCTOR  CRITIQUE  CF  TELETEACH  DELIVERY  SYSTEM 


Use  the  attached  answer  sheet  to  mark  your  responses.  Please  do  MOT  wr i te 
your  narre  or  social  security  number  anywhere  on  the  answer  sheet.  Select 
only  one  answer  to  each  question.  Use  only  a  No.  2  pencil  when  filling 
out  the  answer  sheet.  DO  NOT  USE  INK.  Mark  the  answer  sheet  carefully  to 
negate  computer  error.  Fill  in  the  box  with  a  heavy  mark;  do  not  go  out¬ 
side  the  lines  of  the  box.  If  you  make  a  mistake,  erase  the  mark  com¬ 
pletely  before  entering  a  new  one.  The  last  statement  in  the  critique 
requires  a  written  response.  Put  your  answer  on  the  back  of  the  answer 
sheet . 

Respond  by  using  the  options  A  thru  E  indicating  the  degree  to  which  you 
agree  with  the  statements  below  ( 1  —  1 0 ) .. 


A.  Strongly  agree 

B.  Agree 

C.  Neither  agree  nor  disagree 

D.  Disagree 

E.  Strongly  disagree 

1.  Before  using  the  Teleteach  system,  I  felt  it  wouldn't  be  effective. 

2.  The  Teleteach  system  provides  advantages  not  normally  available. 

3.  Students  at  WPAF3  participated  adequately. 

A.  Students  at  remote  sites  participated  adequately. 

5.  Students  appeared  to  have  learned  the  material  I  presented. 

6.  I  would  like  to  use  the  Teleteach  system  again. 

7.  I  felt  uncomfortabl e  when  I  used  the  Teleteach  system. 

8.  Students  don't  seem  to  learn  well  with  the  Teleteach  system. 

S.  My  inability  to  see  students  at  the  remote  site  was  disconcerting. 

10.  After  using  the  Teleteach  system  I  feel  more  favorable  towards  its  use. 

11.  The  Teleteach  system  caused  me  to  change  my  presentation. 

A.  A  great  deal 

3 .  Some 
C .  Not  at  ail 

12.  If  I  were  to  use  the  Teleteach  system  again,  1  would  change  my 
oresentation. 


A.  A  great  deal 

B.  Seme 

C.  Not  at  al 1 
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APPENDIX  S 

REQUIRED  SITE  CLASSROOM  EQUIPMENT 


REQUIRED  SITE  CLASSROOM  EQUIPMENT 


Equipment  -  Each  Site 


Item 

Manufac¬ 

turer 

Quan¬ 

tity 

Unit 

0  ost 

Total 
0  ost 

A 

Stereo  Tape 
Recorder 

Sony  DC 320 

A 

$202 

$202 

2 . 

3  5mm  Projector 

Kodak 

153 

1  0 

—  n 

3. 

TV  Monitor 
(25”) 

EVM 

2 

LOO 

800 

j, 

-r  • 

Projection 

Screen 

DaLite 

l 

4c 

Lc 

5.  Projection  Table 
(32 5  sq  inches) 

6.  Projection  Stand 
(350  sq  inc’nes- 

60"  high) 


Supply  -  Each  Site 
7-  Microphones- 

?ush-to-Talk  Turner  755  3  54  432 


2  95  19C 

1  100  ICO 


APPENDIX  F 

‘ACULTY  LOGISTICAL  SUPPO 
FOR  TELETEACH 


V 


FROM:  AFIT/LSM-1  15  May  1980 

SUBJ:  Faculty  Logistical  Support  for  Teleteach  (Your  Ltr , 

29  Apr  80) 

TO:  AFIT/ED 

The  following  information  is  offered  in  response  to  above  referenced 
letter.  Since  no  actual  records  were  kept  on  the  amount  of  time 
devoted  to  these  activities,  this  represents  the  best  possible 
estimate,  based  on  initial  preparations  for  the  LOG  220  course. 


Class  80 

-AT. 

a . 

Taking  materials  to 

printing 

-  0 

manhours 

b . 

Return  of  materials 

from  printing 

-  6 

manhours 

c . 

Taking  materials  to 

graphics 

_  * 

d. 

Taking  graphics  materials  to  Tech  or 

Base  Photo 

-  4 

manhours 

e . 

Return  of  materials 
Photo 

from  Tech  or  Base 

-  4 

manhours 

f. 

Placement  of  slides 

into  trays 

-80 

manhours 

g- 

Packaging  materials 

for  shipment 

-40 

manhours 

h . 

Taking  materials  to 

distribution 

-  8 

manhours 

*  This  activity  is  regarded  as  part  of  the  normal  function  of  pre¬ 
paring  for  a  course,  since  the  graphic  material  must  be  developed 
and  reviewed  jointly  by  the  course  director  (or  instructor)  and 
the  graphics  people.  In  preparing  for  this  offering,  several 
hundred  manhours  were  devoted  to  such  joint  efforts. 

/ .  (i 

HAROLD  L.  RUBENSTEIN 
Course  Director,  LOG  220 
School  of  Systems  and  Logistics 
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APPENDIX  G 

COMPUTATION  OF  HOURLY 
INSTRUCTOR  WAGES 


V 


The  following  computations  are  based  on  an  eight 
hour  work  day  with  250  working  days  per  year. 

250  x  3  =  2000  hours  per  year 

GS-13  (Step  6) j 

Annual  wages  $34,269.96 

$34,269.96  7  2000  +  $17.14  per  hour 

GS-12  (Step  6) : 

Annual  wages  $26,937 

$26,937  4  2000  =  $13.47  per  hour 

GS-li  (Step  5): 

Annual  wages  $21,831 

$21,831  4  2000  =  $10.92  per  hour 

GS-5  (Step  5) ' 

Annual  wages  $11,907 

$11,907  4  2000  =  $5-95  per  hour 

0-6: 

Annual  wages  $35,526.96 

$35,526  .  96  4  2000  =  $17.76  per  hour 

0-5: 

Annual  wages  $29,620 . 35 

$29,620.85  4  2000  =  $14.31  per  hour 


0-4: 

Annual  wages  $24,619.99 

$24,619.99  t  2000  =  $12.31  per  hour 

0-3: 

Annual  wages  $21,226.45 

$21,226.45  t  2000  =  $10.6l  per  hour 
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APPENDIX  H 

CHI-SQUARE  CONTINGENCY 
TEDS  v  NCNTEDS  EDUCAT 
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APPENDIX  I 

CHI -SQUARE  CONTINGENCY  TAB! 
TEDS  v  NO NT EDS  AGE 
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APPENDIX  L 

CHI-SQUARE  CONTINGENCY  TA3L 
TEDS  v  NCNTEDS  RANK 


M  n 


APPENDIX  M 

-SQUARE  CONTINGENCY  TA3L 
DS  v  NONTEDS  EXPERIENCE 
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APPENDIX  N 

CHI-SQUARE  CONTINGENCY 
BETWEEN  REMOTES  AC- 


l-n 


E<  W 


APPENDIX  0 

CKI -SQUARE  CONTINGENCY  TABLE 
BETWEEN  REMOTES  EDUCATION 
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